System and method for a six-primary wide gamut color system

ABSTRACT

Systems and methods for a six-primary color system for display. A six-primary color system increases the number of primary colors available in a color system and color system equipment. Increasing the number of primary colors reduces metameric errors from viewer to viewer. The six-primary color system includes Red, Green, Blue, Cyan, Yellow, and Magenta primaries. The systems of the present invention maintain compatibility with existing color systems and equipment and provide systems for backwards compatibility with older color systems.

CROSS REFERENCES TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.17/060,869, filed Oct. 1, 2020, which is a continuation of U.S.application Ser. No. 17/009,408, filed Sep. 1, 2020, which is acontinuation-in-part of U.S. application Ser. No. 16/887,807, filed May29, 2020, which is a continuation-in-part of U.S. application Ser. No.16/860,769, filed Apr. 28, 2020, which is a continuation-in-part of U.S.application Ser. No. 16/853,203, filed Apr. 20, 2020, which is acontinuation-in-part of U.S. patent application Ser. No. 16/831,157,filed Mar. 26, 2020, which is a continuation of U.S. patent applicationSer. No. 16/659,307, filed Oct. 21, 2019, now U.S. Pat. No. 10,607,527,which is related to and claims priority from U.S. Provisional PatentApplication No. 62/876,878, filed Jul. 22, 2019, U.S. Provisional PatentApplication No. 62/847,630, filed May 14, 2019, U.S. Provisional PatentApplication No. 62/805,705, filed Feb. 14, 2019, and U.S. ProvisionalPatent Application No. 62/750,673, filed Oct. 25, 2018, each of which isincorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to color systems, and more specifically toa wide gamut color system with an increased number of primary colors.

2. Description of the Prior Art

It is generally known in the prior art to provide for an increased colorgamut system within a display.

Prior art patent documents include the following:

U.S. Pat. No. 10,222,263 for RGB value calculation device by inventorYasuyuki Shigezane, filed Feb. 6, 2017 and issued Mar. 5, 2019, isdirected to a microcomputer that equally divides the circumference of anRGB circle into 6×n (n is an integer of 1 or more) parts, and calculatesan RGB value of each divided color. (255, 0, 0) is stored as a referenceRGB value of a reference color in a ROM in the microcomputer. Themicrocomputer converts the reference RGB value depending on an angulardifference of the RGB circle between a designated color whose RGB valueis to be found and the reference color, and assumes the converted RGBvalue as an RGB value of the designated color.

U.S. Pat. No. 9,373,305 for Semiconductor device, image processingsystem and program by inventor Hiorfumi Kawaguchi, filed May 29, 2015and issued Jun. 21, 2016, is directed to an image process deviceincluding a display panel operable to provide an input interface forreceiving an input of an adjustment value of at least a part of colorattributes of each vertex of n axes (n is an integer equal to or greaterthan 3) serving as adjustment axes in an RGB color space, and anadjustment data generation unit operable to calculate the degree ofinfluence indicative of a following index of each of the n-axisvertices, for each of the n axes, on a basis of distance between each ofthe n-axis vertices and a target point which is an arbitrary latticepoint in the RGB color space, and operable to calculate adjustedcoordinates of the target point in the RGB color space.

U.S. Publication No. 20130278993 for Color-mixing bi-primary colorsystems for displays by inventor Heikenfeld, et. al, filed Sep. 1, 2011and published Oct. 24, 2013, is directed to a display pixel. The pixelincludes first and second substrates arranged to define a channel. Afluid is located within the channel and includes a first colorant and asecond colorant. The first colorant has a first charge and a color. Thesecond colorant has a second charge that is opposite in polarity to thefirst charge and a color that is complimentary to the color of the firstcolorant. A first electrode, with a voltage source, is operably coupledto the fluid and configured to moving one or both of the first andsecond colorants within the fluid and alter at least one spectralproperty of the pixel.

U.S. Pat. No. 8,599,226 for Device and method of data conversion forwide gamut displays by inventor Ben-Chorin, et. al, filed Feb. 13, 2012and issued Dec. 3, 2013, is directed to a method and system forconverting color image data from a, for example, three-dimensional colorspace format to a format usable by an n-primary display, wherein n isgreater than or equal to 3. The system may define a two-dimensionalsub-space having a plurality of two-dimensional positions, each positionrepresenting a set of n primary color values and a third, scaleablecoordinate value for generating an n-primary display input signal.Furthermore, the system may receive a three-dimensional color spaceinput signal including out-of range pixel data not reproducible by athree-primary additive display, and may convert the data to side gamutcolor image pixel data suitable for driving the wide gamut colordisplay.

U.S. Pat. No. 8,081,835 for Multiprimary color sub-pixel rendering withmetameric filtering by inventor Elliot, et. al, filed Jul. 13, 2010 andissued Dec. 20, 2011, is directed to systems and methods of renderingimage data to multiprimary displays that adjusts image data acrossmetamers as herein disclosed. The metamer filtering may be based uponinput image content and may optimize sub-pixel values to improve imagerendering accuracy or perception. The optimizations may be madeaccording to many possible desired effects. One embodiment comprises adisplay system comprising: a display, said display capable of selectingfrom a set of image data values, said set comprising at least onemetamer; an input image data unit; a spatial frequency detection unit,said spatial frequency detection unit extracting a spatial frequencycharacteristic from said input image data; and a selection unit, saidunit selecting image data from said metamer according to said spatialfrequency characteristic.

U.S. Pat. No. 7,916,939 for High brightness wide gamut display byinventor Roth, et. al, filed Nov. 30, 2009 and issued Mar. 29, 2011, isdirected to a device to produce a color image, the device including acolor filtering arrangement to produce at least four colors, each colorproduced by a filter on a color filtering mechanism having a relativesegment size, wherein the relative segment sizes of at least two of theprimary colors differ.

U.S. Pat. No. 6,769,772 for Six color display apparatus having increasedcolor gamut by inventor Roddy, et. al, filed Oct. 11, 2002 and issuedAug. 3, 2004, is directed to a display system for digital color imagesusing six color light sources or two or more multicolor LED arrays orOLEDs to provide an expanded color gamut. Apparatus uses two or morespatial light modulators, which may be cycled between two or more colorlight sources or LED arrays to provide a six-color display output.Pairing of modulated colors using relative luminance helps to minimizeflicker effects.

SUMMARY OF THE INVENTION

It is an object of this invention to provide an enhancement to thecurrent RGB systems or a replacement for them.

In one embodiment, the present invention is a system for displaying asix primary color system, including a set of image data, wherein the setof image data is comprised of a first set of color channel data and asecond set of color channel data, wherein the set of image data furtherincludes a bit level, an image data converter, wherein the image dataconverter includes a digital interface, wherein the digital interface isoperable to encode and decode the set of image data, at least onetransfer function (TF) for processing the set of image data, a set ofSession Description Protocol (SDP) parameters, wherein the set of SDPparameters is modifiable, at least one display device, wherein the atleast one display device and the image data converter are in networkcommunication, wherein the image data converter is operable to convertthe bit level of the set of image data, thereby creating an updated bitlevel, wherein the image data converter is operable to convert the setof image data for display on the at least one display device, whereinonce the set of image data has been converted by the image dataconverter for the at least one display device the set of SDP parametersare modified based on the conversion, and wherein the at least onedisplay device is operable to display a six-primary color system basedon the set of image data, such that the SDP parameters indicate that theset of image data being displayed on the at least one display device isusing a six-primary color system.

In another embodiment, the present invention is a system for displayinga six-primary color system, including a set of image data, wherein theset of image data includes a first set of color channel data and asecond set of color channel data, wherein the set of image data includesa bit level, a magenta primary value, wherein the magenta primary valueis derived from the set of image data, an image data converter, whereinthe image data converter includes a digital interface, wherein thedigital interface is operable to encode and decode the set of imagedata, at least one transfer function (TF) for processing the set ofimage data, a set of Session Description Protocol (SDP) parameters,wherein the set of SDP parameters are modifiable, at least one displaydevice, wherein the at least one display device and the image dataconverter are in network communication, wherein the image data converteris operable to convert the bit level for the set of image data to a newbit level, wherein the at least one data converter is operable toconvert the set of image data for display on the at least one displaydevice, wherein once the set of image data has been converted for the atleast one display device the set of SDP parameters are modified based onthe conversion, and wherein the at least one display device is operableto display a six-primary color system based on the set of image data,such that the SDP parameters indicate the magenta primary value and thatthe set of image data being displayed on the at least one display deviceis using a six-primary color system.

In yet another embodiment, the present invention is a system fordisplaying a set of image data using a six-primary color system,including a set of image data, wherein the set of image data includes abit level, a magenta primary value, wherein the magenta primary value isderived from the set of image data, an image data converter, wherein theimage data converter includes a digital interface, wherein the digitalinterface is operable to encode and decode the set of image data, atleast one transfer function (TF) for processing the set of image data, aset of Session Description Protocol (SDP) parameters, wherein the set ofSDP parameters are modifiable, at least one electronic luminancecomponent, wherein the electronic luminance component is derived fromthe set of image data, at least one display device, wherein the at leastone display device and the image data converter are in networkcommunication, wherein the image data converter is operable to convertthe set of image data to a new bit level, wherein the at least one imagedata converter is operable to convert the set of image data for displayon the at least one display device, wherein once the set of image datahas been converted for the at least one display device the set of SDPparameters are modified based on the conversion, and wherein the atleast one display device is operable to display a six-primary colorsystem based on the set of image data, such that the SDP parametersindicate the magenta primary value, the at least one electronicluminance component, and that the set of image data being displayed onthe at least one display device is using a six-primary color system.

These and other aspects of the present invention will become apparent tothose skilled in the art after a reading of the following description ofthe preferred embodiment when considered with the drawings, as theysupport the claimed invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolor drawing(s) will be provided by the Office upon request and paymentof the necessary fee.

FIG. 1 illustrates color spectrum.

FIG. 2 illustrates an adaptive optics view of the mosaic of L (red), M(green), and S (blue) cones in four human subjects with normal colorvision.

FIG. 3A illustrates the spectral output of an LCD display using a CCFLbacklight and a simulation of what Viewer A is sensitive to.

FIG. 3B illustrates the spectral output of an LCD display using a CCFLbacklight and a simulation of what Viewer B is sensitive to.

FIG. 4A illustrates a spectral output of a laser driven display usingdiscrete RGB laser emitters and a simulation of what Viewer A issensitive to, where the display is using an ITU-R BT.2020 gamut.

FIG. 4B illustrates a spectral output of a laser driven display usingdiscrete RGB laser emitters and a simulation of what Viewer B issensitive to, where the display is using an ITU-R BT.2020 gamut.

FIG. 5 illustrates how a display simulates color using the Commission onIllumination (CIE 1976) color space shown as L*a*b.

FIG. 6 illustrates a comparison of the ITU-R BT.2020 color gamut to thePointer data set of real colors.

FIG. 7 illustrates a comparison of the ITU-R BT.709-6 color gamut to thePointer data set of real colors.

FIG. 8 illustrates the CYM hue angles added to a legacy RGB color gamutbased on equal saturation defined by ITU-R BT.709-6.

FIG. 9 illustrates a RGBCYM system based on the ITU-R BT.709-6 colorsaturation shown over the Pointer data set of real colors.

FIG. 10A illustrates a comparison of the overall gamut values between asix-primary system and an ITU-R BT.2020 system, with estimateddifferences between spectral displayed outputs.

FIG. 10B illustrates an RGBCYM system based on ITU-R BR 709 ColorSaturation (6P-B).

FIG. 10C illustrates the ITU-R BR.2020 spectral recommendation.

FIG. 10D illustrates the ITU-R BT.2020 system. In one embodiment, thewhite point is a D60 white point

FIG. 11 illustrates a RGBCYM system based on ITU-R BT.709 colorsaturation compared to ITU-R BT.2020.

FIG. 12 illustrates a comparison between ITU-R BT.709, SMPTE RP431-2,and ITU-R BT.2020 color gamuts.

FIG. 13 illustrates the Pointer color data set with a six-primary colorsystem based on SMPTE RP431-2 saturation and ITU-R BT.2020 superimposed.

FIG. 14 illustrates a RGBCYM system compared to a Sony S gamut, ArriAWG, and ACES AP0.

FIG. 15 illustrates the workflow to use a six-primary color system usinga new input transfer transform.

FIG. 16A illustrates a mosaic filter configuration using a magentafilter for the present invention.

FIG. 16B illustrates a mosaic filter configuration not using a magentafilter for the present invention.

FIG. 17 illustrates an expansion to the demuxing process to handle theplacement of additional color elements.

FIG. 18 illustrates a signal inversion process in a single imagercamera.

FIG. 19 illustrates a prism made up of three glass elements and twodichroic filters.

FIG. 20 illustrates a prism design for a six-imager camera for use in asix-primary color system.

FIG. 21 illustrates an embodiment of an encode and decode system for asix-primary color system.

FIG. 22 illustrates a sequential method where three color primaries arepassed to the transport format as full bit level image data and insertedas normal.

FIG. 23 illustrates one embodiment of a six-primary color system encodeusing a 4:4:4 sampling method.

FIG. 24 illustrates one embodiment for a method to package six channelsof primary information into the three standard primary channels used incurrent serial video standards by modifying bit numbers for a 12-bit SDIand a 10-bit SDI.

FIG. 25 illustrates a simplified diagram estimating perceived viewersensation as code values define each hue angle.

FIG. 26 illustrates one embodiment for a method of stacking/encodingsix-primary color information using a 4:4:4 video system.

FIG. 27 illustrates one embodiment for a method of unstacking/decodingsix-primary color information using a 4:4:4 video system.

FIG. 28 illustrates one embodiment of a 4:4:4 decoder for a six-primarycolor system.

FIG. 29 illustrates an embodiment of the present invention for sendingsix primary colors to a standardized transport format.

FIG. 30 illustrates one embodiment of a decode process adding a pixeldelay to the RGB data for realigning the channels to a common pixeltiming.

FIG. 31 illustrates one embodiment of an encode process for 4:2:2 videofor packaging five channels of information into the standardthree-channel designs.

FIG. 32 illustrates one embodiment for a non-constant luminance encodefor a six-primary color system.

FIG. 33 illustrates one embodiment of a packaging process for asix-primary color system.

FIG. 34 illustrates a 4:2:2 unstack process for a six-primary colorsystem.

FIG. 35 illustrates one embodiment of a process to inversely quantizeeach individual color and pass the data through an electronic opticalfunction transfer (EOTF) in a non-constant luminance system.

FIG. 36 illustrates one embodiment of a constant luminance encode for asix-primary color system.

FIG. 37 illustrates one embodiment of a constant luminance decode for asix-primary color system.

FIG. 38 illustrates one example of 4:2:2 non-constant luminanceencoding. (illustrates one embodiment for channeling six-primary colorsystem output into a standard SMPTE ST292 serial system.)

FIG. 39 illustrates one embodiment of a non-constant luminance decodingsystem.

FIG. 40 illustrates one embodiment of a 4:2:2 constant luminanceencoding system.

FIG. 41 illustrates one embodiment of a 4:2:2 constant luminancedecoding system.

FIG. 42 illustrates a raster encoding diagram of sample placements for asix-primary color system.

FIG. 43 illustrates one embodiment of the six-primary color unstackprocess in a 4:2:2 video system.

FIG. 44 illustrates one embodiment of mapping input to the six-primarycolor system unstack process.

FIG. 45 illustrates one embodiment of mapping the output of asix-primary color system decoder.

FIG. 46 illustrates one embodiment of mapping the RGB decode for asix-primary color system.

FIG. 47 illustrates one embodiment of six-primary color output using anon-constant luminance decoder.

FIG. 48 illustrates one embodiment of a legacy RGB process within asix-primary color system.

FIG. 49 illustrates one embodiment of an unstack system for asix-primary color system.

FIG. 50 illustrates one embodiment of a legacy RGB decoder for asix-primary, non-constant luminance system.

FIG. 51 illustrates one embodiment of a legacy RGB decoder for asix-primary, constant luminance system.

FIG. 52 illustrates one embodiment of a six-primary color system withoutput to a legacy RGB system.

FIG. 53 illustrates one embodiment of packing six-primary color systemimage data into an IC_(T)C_(P) (ITP) format.

FIG. 54 illustrates one embodiment of a six-primary color systemconverting RGBCYM image data into XYZ image data for an ITP format.

FIG. 55 illustrates one embodiment of six-primary color mapping withSMPTE ST424.

FIG. 56 illustrates one embodiment of a six-primary color system readoutfor an SMPTE ST424 standard.

FIG. 57 illustrates one embodiment for mapping RGBCYM data to the SMPTEST2082 standard for a six-primary color system.

FIG. 58 illustrates one embodiment for mapping Y_(RGB) Y_(CYM) C_(R)C_(B) C_(C) C_(Y) data to the SMPTE ST2082 standard for a six-primarycolor system.

FIG. 59 illustrates one embodiment for mapping six-primary color systemdata using the SMPTE ST292 standard.

FIG. 60 illustrates one embodiment of the readout for a six-primarycolor system using the SMPTE ST292 standard.

FIG. 61 illustrates modifications to the SMPTE ST352 standards for asix-primary color system.

FIG. 62 illustrates modifications to the SMPTE ST2022 standard for asix-primary color system.

FIG. 63 illustrates a table of 4:4:4 sampling for a six-primary colorsystem for a 10-bit video system.

FIG. 64 illustrates a table of 4:4:4 sampling for a six-primary colorsystem for a 12-bit video system.

FIG. 65 illustrates sequence substitutions for 10-bit and 12-bit videoin 4:2:2 sampling systems in a Y Cb Cr Cc Cy color space.

FIG. 66 illustrates sample placements of six-primary system componentsfor a 4:2:2 sampling system image.

FIG. 67 illustrates sequence substitutions for 10-bit and 12-bit videoin 4:2:0 sampling systems using a Y Cb Cr Cc Cy color space.

FIG. 68 illustrates sample placements of six-primary system componentsfor a 4:2:0 sampling system image.

FIG. 69 illustrates modifications to SMPTE ST2110-20 for a 10-bitsix-primary color system in 4:4:4 video.

FIG. 70 illustrates modifications to SMPTE ST2110-20 for a 12-bitsix-primary color system in 4:4:4 video.

FIG. 71 illustrates modifications to SMPTE ST2110-20 for a 10-bit sixprimary color system in 4:2:2 video.

FIG. 72 illustrates modifications to SMPTE ST2110-20 for a 12-bitsix-primary color system in 4:2:0 video.

FIG. 73 illustrates an RGB sampling transmission for a 4:4:4 samplingsystem.

FIG. 74 illustrates a RGBCYM sampling transmission for a 4:4:4 samplingsystem.

FIG. 75 illustrates an example of System 2 to RGBCYM 4:4:4 transmission.

FIG. 76 illustrates a Y Cb Cr sampling transmission using a 4:2:2sampling system.

FIG. 77 illustrates a Y Cr Cb Cc Cy sampling transmission using a 4:2:2sampling system.

FIG. 78 illustrates an example of a System 2 to Y Cr Cb Cc Cy 4:2:2Transmission as non-constant luminance.

FIG. 79 illustrates a Y Cb Cr sampling transmission using a 4:2:0sampling system.

FIG. 80 illustrates a Y Cr Cb Cc Cy sampling transmission using a 4:2:0sampling system.

FIG. 81 illustrates a dual stack LCD projection system for a six-primarycolor system.

FIG. 82 illustrates one embodiment of a single projector.

FIG. 83 illustrates a six-primary color system using a single projectorand reciprocal mirrors.

FIG. 84 illustrates a dual stack DMD projection system for a six-primarycolor system.

FIG. 85 illustrates one embodiment of a single DMD projector solution.

FIG. 86 illustrates one embodiment of a color filter array for asix-primary color system with a white OLED monitor.

FIG. 87 illustrates one embodiment of an optical filter array for asix-primary color system with a white OLED monitor.

FIG. 88 illustrates one embodiment of a matrix of an LCD drive for asix-primary color system with a backlight illuminated LCD monitor.

FIG. 89 illustrates one embodiment of an optical filter array for asix-primary color system with a backlight illuminated LCD monitor.

FIG. 90 illustrates an array for a Quantum Dot (QD) display device.

FIG. 91 illustrates one embodiment of an array for a six-primary colorsystem for use with a direct emissive assembled display.

FIG. 92 illustrates one embodiment of a six-primary color system in anemissive display that does not incorporate color filtered subpixels.

FIG. 93 illustrates one embodiment of an optical filter.

FIG. 94 illustrates another embodiment of an optical filter.

FIG. 95 illustrates one embodiment of a system encode and decode processusing a dual link method.

FIG. 96 illustrates one embodiment of an encoding process using a duallink method.

FIG. 97 illustrates one embodiment of a decoding process using a duallink method.

FIG. 98 illustrates one embodiment of a new extended gamut system.

FIG. 99 illustrates another embodiment of a new extended gamut system.

FIG. 100 illustrates one embodiment of a multi-primary triad processusing CIE-1931 color space.

FIG. 101 illustrates a table of Blue to Red line edge values between RGBand RMB triads.

FIG. 102 illustrates a YWV plot of a 6P system and an ACES 0 system.

FIG. 103 illustrates a table corresponding to chromaticity matrix valuesfor a 6P system

FIG. 104 illustrates a gamut using 6P-B chromaticity values for anACES-to-6P-to-ACES conversion process.

FIG. 105 illustrates a process to validate the ACES-to-6P-to-ACESconversion process according to one embodiment of the present invention.

FIG. 106 illustrates Super 6Pa compared to 6P-C.

FIG. 107 is a table of values for Super 6Pa.

FIG. 108 illustrates Super 6Pb compared to Super 6Pa and 6P-C.

FIG. 109 is a table of values for Super 6Pb.

FIG. 110 is a table of values for 6P-B.

FIG. 111 illustrates 6P-B compared to ITU-R BT.709-6.

FIG. 112 is a table of values for 6P-C.

FIG. 113 illustrates 6P-C compared to SMPTE RP431-2.

FIG. 114 illustrates a process of 2160p transport over 12G-SDI.

FIG. 115 is a schematic diagram of an embodiment of the inventionillustrating a computer system.

DETAILED DESCRIPTION

The present invention is generally directed to a six-primary colorsystem.

In one embodiment, the present invention is a system for displaying asix primary color system, including a set of image data, wherein the setof image data is comprised of a first set of color channel data and asecond set of color channel data, wherein the set of image data furtherincludes a bit level, an image data converter, wherein the image dataconverter includes a digital interface, wherein the digital interface isoperable to encode and decode the set of image data, at least onetransfer function (TF) for processing the set of image data, a set ofSession Description Protocol (SDP) parameters, wherein the set of SDPparameters is modifiable, at least one display device, wherein the atleast one display device and the image data converter are in networkcommunication, wherein the image data converter is operable to convertthe bit level of the set of image data, thereby creating an updated bitlevel, wherein the image data converter is operable to convert the setof image data for display on the at least one display device, whereinonce the set of image data has been converted by the image dataconverter for the at least one display device the set of SDP parametersare modified based on the conversion, and wherein the at least onedisplay device is operable to display a six-primary color system basedon the set of image data, such that the SDP parameters indicate that theset of image data being displayed on the at least one display device isusing a six-primary color system. In one embodiment, the first set ofcolor channel data is a set of values for red (R), green (G), and blue(B) (collectively “RGB”) primaries and the second set of color channeldata is a set of values for cyan (C), yellow (Y), and magenta (M)(collectively “CYM”) primaries. In one embodiment, the bit level of theset of image data is 12 bits, wherein the image data converter remapsthe bit level to 11 bits using the at least one TF, wherein the outputfrom the at least one TF includes the updated bit level, wherein theupdated bit level is 11 bits. In one embodiment, the bit level of theset of image data is 10 bits, wherein the image data converter remapsthe bit level to 9 bits using the at least one TF, wherein the outputfrom the at least one TF includes the updated bit level, wherein theupdated bit level is 9 bits. In another embodiment, the system includesa set of saturation data corresponding to the set of image data, whereinthe saturation data is calculated using the first set of color channeldata, the second set of color channel data, and an illuminant whitepoint, wherein the illuminant white point is the Standard Illuminant D65(D65) white point, wherein the saturation data is used to extend a setof hue angles for the first set of color channel data and the second setof color channel data, wherein extending the hue angles produces anupdated set of image data with equal saturation values. In yet anotherembodiment, the first set of color channel data includes a first bitvalue defining black and a first bit value defining white, wherein thesecond set of color channel data includes a second bit value definingblack and a second bit level defining white, wherein the TF is operableto redefine the first bit value defining black, the first bit leveldefining white, the second bit level defining black, and the second bitlevel defining white. In yet another embodiment, the set of SDPparameters are modified to include data corresponding to the first setof color channel data and the second set of color channel data, whereinthe first set of color channel data is a set of values for RGB primariesand the second set of color channel data is a set of values for CYMprimaries. In yet another embodiment, the digital interface encodes anddecodes the set of image data using at least one color differencecomponent, wherein the at least one color difference component isoperable for up-sampling and/or down-sampling.

In another embodiment, the present invention is a system for displayinga six-primary color system, including a set of image data, wherein theset of image data includes a first set of color channel data and asecond set of color channel data, wherein the set of image data includesa bit level, a magenta primary value, wherein the magenta primary valueis derived from the set of image data, an image data converter, whereinthe image data converter includes a digital interface, wherein thedigital interface is operable to encode and decode the set of imagedata, at least one transfer function (TF) for processing the set ofimage data, a set of Session Description Protocol (SDP) parameters,wherein the set of SDP parameters are modifiable, at least one displaydevice, wherein the at least one display device and the image dataconverter are in network communication, wherein the image data converteris operable to convert the bit level for the set of image data to a newbit level, wherein the at least one data converter is operable toconvert the set of image data for display on the at least one displaydevice, wherein once the set of image data has been converted for the atleast one display device the set of SDP parameters are modified based onthe conversion, and wherein the at least one display device is operableto display a six-primary color system based on the set of image data,such that the SDP parameters indicate the magenta primary value and thatthe set of image data being displayed on the at least one display deviceis using a six-primary color system. In one embodiment, the first set ofcolor channel data is a set of values for red (R), green (G), and blue(B) (collectively “RGB”) primaries and the second set of color channeldata is a set of values for cyan (C), yellow (Y), and magenta (M)(collectively “CYM”) primaries, wherein the M primary value iscalculated based on values for R and B from the first set of colorchannel data. In one embodiment, the first set of color channel datadefines a first minimum color luminance and a first maximum colorluminance, wherein the second set of color channel data defines a secondminimum color luminance and a second maximum color luminance. In anotherembodiment, the at least one TF quantizes the bit level of the set ofimage data to a lower bit level, thereby creating an updated bit levelfor the set of image data. In another embodiment, a peak brightness anda minimum brightness are calculated for the first set of color channeldata and the second set of color channel data. In another embodiment,the system includes a standardized transport format, wherein thestandardized transport format is operable to receive the first set ofimage data and the second set of image data as a combined set of imagedata, wherein the combined set of image data has a combined bit levelequal to the bit level for the set of image data. In yet anotherembodiment, the SDP parameters include the first set of color channeldata, the second set of color channel data, mapping data for the set ofimage data, framerate data for the set of image data, a samplingstandard for the set of image data, a flag indicator, an active picturesize code, a timestamp for the set of image data, a clock frequency forthe set of image data, a frame count for the set of image data, ascrambling indicator, and/or a video format indicator. In yet anotherembodiment, the system includes a set of saturation data correspondingto the set of image data, wherein the saturation data is calculatedusing the first set of color channel data, the second set of colorchannel data, and an illuminant white point, wherein the illuminantwhite point is the Standard Illuminant D60 (D60) white point. In yetanother embodiment, the at least one TF is an EOTF. In yet anotherembodiment, the magenta primary value is not defined as a wavelength.

In yet another embodiment, the present invention is a system fordisplaying a set of image data using a six-primary color system,including a set of image data, wherein the set of image data includes abit level, a magenta primary value, wherein the magenta primary value isderived from the set of image data, an image data converter, wherein theimage data converter includes a digital interface, wherein the digitalinterface is operable to encode and decode the set of image data, atleast one transfer function (TF) for processing the set of image data, aset of Session Description Protocol (SDP) parameters, wherein the set ofSDP parameters are modifiable, at least one electronic luminancecomponent, wherein the electronic luminance component is derived fromthe set of image data, at least one display device, wherein the at leastone display device and the image data converter are in networkcommunication, wherein the image data converter is operable to convertthe set of image data to a new bit level, wherein the at least one imagedata converter is operable to convert the set of image data for displayon the at least one display device, wherein once the set of image datahas been converted for the at least one display device the set of SDPparameters are modified based on the conversion, and wherein the atleast one display device is operable to display a six-primary colorsystem based on the set of image data, such that the SDP parametersindicate the magenta primary value, the at least one electronicluminance component, and that the set of image data being displayed onthe at least one display device is using a six-primary color system. Inone embodiment, the at least one electronic luminance component is notcalculated within the at least one display. In one embodiment, the setof image data includes red (R), green (G), blue (B), cyan (C), yellow(Y), and magenta (M) color primary values, wherein the magenta primaryvalue is calculated based on the R and B color primary values. In oneembodiment, the at least one TF is an OOTF. In another embodiment, thesystem further includes a sampling system, wherein the sampling systemis a 4:4:4 sampling system, wherein the sampling system includes a bitfor black and a bit for white, wherein the bit for black and the bit forwhite are operable to redefined within the sampling system. In anotherembodiment, the bit level for the set of image data is 12 bits. Inanother embodiment, the bit level for the set of image data is 10 bits.In yet another embodiment, the image data converter encoding anddecoding are based on the ITU-R BT.709 color space. In yet anotherembodiment, the image data converter encoding and decoding are based onthe SMPTE RP431-2 color space. In yet another embodiment, the set ofimage data is converted by the image data converter in real-time and/ornear real-time. In yet another embodiment, the digital interfaceincludes payload identification (ID) metadata, wherein the payload IDmetadata is operable to identify the set of image data as a six-primarycolor set of image data.

The present invention relates to color systems. A multitude of colorsystems are known, but they continue to suffer numerous issues. Asimaging technology is moving forward, there has been a significantinterest in expanding the range of colors that are replicated onelectronic displays. Enhancements to the television system have expandedfrom the early CCIR 601 standard to ITU-R BT.709-6, to SMPTE RP431-2,and ITU-R BT.2020. Each one has increased the gamut of visible colors byexpanding the distance from the reference white point to the position ofthe Red (R), Green (G), and Blue (B) color primaries (collectively knownas “RGB”) in chromaticity space. While this approach works, it hasseveral disadvantages. When implemented in content presentation, issuesarise due to the technical methods used to expand the gamut of colorsseen (typically using a more-narrow emissive spectrum) can result inincreased viewer metameric errors and require increased power due tolower illumination source. These issues increase both capital andoperational costs.

With the current available technologies, displays are limited in respectto their range of color and light output. There are many misconceptionsregarding how viewers interpret the display output technically versusreal-world sensations viewed with the human eye. The reason we see morethan just the three emitting primary colors is because the eye combinesthe spectral wavelengths incident on it into the three bands. Humansinterpret the radiant energy (spectrum and amplitude) from a display andprocess it so that an individual color is perceived. The display doesnot emit a color or a specific wavelength that directly relates to thesensation of color. It simply radiates energy at the same spectrum whichhumans sense as light and color. It is the observer who interprets thisenergy as color.

When the CIE 2° standard observer was established in 1931, commonunderstanding of color sensation was that the eye used red, blue, andgreen cone receptors (James Maxwell & James Forbes 1855). Later with theMunsell vision model (Munsell 1915), Munsell described the vision systemto include three separate components: luminance, hue, and saturation.Using RGB emitters or filters, these three primary colors are thecomponents used to produce images on today's modern electronic displays.

There are three primary physical variables that affect sensation ofcolor. These are the spectral distribution of radiant energy as it isabsorbed into the retina, the sensitivity of the eye in relation to theintensity of light landing on the retinal pigment epithelium, and thedistribution of cones within the retina. The distribution of cones(e.g., L cones, M cones, and S cones) varies considerably from person toperson.

Enhancements in brightness have been accomplished through largerbacklights or higher efficiency phosphors. Encoding of higher dynamicranges is addressed using higher range, more perceptually uniformelectro-optical transfer functions to support these enhancements tobrightness technology, while wider color gamuts are produced by usingnarrow bandwidth emissions. Narrower bandwidth emitters result in theviewer experiencing higher color saturation. But there can be adisconnect between how saturation is produced and how it is controlled.What is believed to occur when changing saturation is that increasingcolor values of a color primary represents an increase to saturation.This is not true, as changing saturation requires the variance of acolor primary spectral output as parametric. There are no variablespectrum displays available to date as the technology to do so has notbeen commercially developed, nor has the new infrastructure required tosupport this been discussed.

Instead, the method that a display changes for viewer color sensation isby changing color luminance. As data values increase, the color primarygets brighter. Changes to color saturation are accomplished by varyingthe brightness of all three primaries and taking advantage of thedominant color theory.

Expanding color primaries beyond RGB has been discussed before. Therehave been numerous designs of multi-primary displays. For example, SHARPhas attempted this with their four-color QUATTRON TV systems by adding ayellow color primary and developing an algorithm to drive it. Anotherfour primary color display was proposed by Matthew Brennesholtz whichincluded an additional cyan primary, and a six primary display wasdescribed by Yan Xiong, Fei Deng, Shan Xu, and Sufang Gao of the Schoolof Physics and Optoelectric Engineering at the Yangtze UniversityJingzhou China. In addition, AU OPTRONICS has developed a five primarydisplay technology. SONY has also recently disclosed a camera designfeaturing RGBCMY (red, green, blue, cyan, magenta, and yellow) andRGBCMYW (red, green, blue cyan, magenta, yellow, and white) sensors.

Actual working displays have been shown publicly as far back as the late1990's, including samples from Tokyo Polytechnic University, Nagoya CityUniversity, and Genoa Technologies. However, all of these systems areexclusive to their displays, and any additional color primaryinformation is limited to the display's internal processing.

Additionally, the Visual Arts System for Archiving and Retrieval ofImages (VASARI) project developed a colorimetric scanner system fordirect digital imaging of paintings. The system provides more accuratecoloring than conventional film, allowing it to replace filmphotography. Despite the project beginning in 1989, technicaldevelopments have continued. Additional information is available athttps://www.southampton.ac.uk/˜km2/projs/vasari/ (last accessed Mar. 30,2020), which is incorporated herein by reference in its entirety.

None of the prior art discloses developing additional color primaryinformation outside of the display. Moreover, the system driving thedisplay is often proprietary to the demonstration. In each of theseexecutions, nothing in the workflow is included to acquire or generateadditional color primary information. The development of a six-primarycolor system is not complete if the only part of the system thatsupports the added primaries is within the display itself.

Referring now to the drawings in general, the illustrations are for thepurpose of describing one or more preferred embodiments of the inventionand are not intended to limit the invention thereto.

FIG. 1 illustrates one example of a color spectrum. The color spectrumcan be stated as a colorimetric measurement, indicating the presence often distinct colors, and a radiometric measurement, wherein there areten combinations of three distinct spectra. Colors on the spectruminclude, but are not limited to red (R), blue (B), green (G), cyan (C),yellow (Y), and magenta (M).

FIG. 2 illustrates an adaptive optics view of the mosaic of L cones(shown in red), M cones (shown in green), and S cones (shown in blue) infour human subjects with normal color vision. The ratio of S to L and Mcones is constant but that of L to M cones varies from 1:2.7 (L:M) to16.51:1 (L:M).

FIG. 3A and FIG. 3B illustrate spectral output of an LCD display using acold cathode fluorescent lamp (CCFL) backlight and a simulation of whatViewer A and Viewer B are sensitive to, respectively. The display outputhas a fairly broad spectral distribution (white arrow), so as the viewerlooks at the image, differences in viewer sensitivity can be covered bythis wider spectral distribution output from the display. The coloredarrows show that the majority of the spectrum output falls under thearea of the viewer's sensitivity. This means that the viewer has moreinformation available to judge what that color is and that fewermetamerism issues are present.

FIG. 4A and FIG. 4B illustrate spectral output of a laser driven displayusing discrete RGB laser emitters and a simulation of what each vieweris sensitive to, where the display is using an ITU-R BT.2020 gamut. Asshown from the colored arrows, the level of sensitivity for each colorprimary emission crosses a very different level between the two viewers.Also illustrated by the purple arrows are large gaps in the outputspectrum where no radiant energy is emitted. This results in the eyeseeing less light for the same spectral peak amplitude. This results ingreater color discrepancy from viewer-to-viewer.

FIG. 5 illustrates how a display simulates color using the Commission onIllumination (CIE 1976) color space shown as L*a*b (CIELAB). CIELABcolor space is a color space defined by the International Commission onIllumination (CIE) in 1976. It expresses color as three values: L* forthe lightness from black (0) to white (100), a* from green (−) to red(+), and b* from blue (−) to yellow (+). CIELAB was designed so that thesame amount of numerical change in these values corresponds roughly tothe same amount of visually perceived change. The CIELAB color space istypically used when graphics for print have to be converted from RGB toCMYK, as the CIELAB gamut includes both the gamuts of Red (R), Green(G), and Blue (B) (collectively RGB) and Cyan (C), Magenta (M), Yellow(Y), and Black (K) (collectively CMYK) color models. Because threeparameters are measured, the space itself is a three-dimensional (3D)real number space, allowing for infinitely many possible colors. Inpractice, the space is mapped onto a 3D integer space for digitalrepresentation. Referring to FIG. 5, what an observer thinks whenchanging saturations is that increasing values of a color primaryincrease color saturation (assumption shown on left side of figure).While this is true, it is not practical. There are no variable spectrumdisplays available to date as the technology to do this has not beencommercially developed. Neither has the new infrastructure required tosupport this even been discussed.

Color saturation increases are actually accomplished by increasingbrightness of the brightest primary for a particular color and reducingbrightness for the other two primaries. The limiting saturation of thedisplay does not change.

FIG. 6 illustrates a comparison of the ITU-R BT.2020 color gamut to thePointer data set of real colors. ITU-R BT.2020 was designed to make amaximum range of colors within an RGB space. To do this, the standardassigns its color primaries to the edge of the 1931 standard observerlocus. In order to make this work, the color primaries are in effectsingle frequency emitters with center frequencies at 630 nm (Red), 532nm (Green), and 467 nm (Blue). If viewed as CIE 1976 Yu′v′, this looksquite large and should have a maximum range of color. ITU-R BT.2020completely covers all of Pointer's data set. This should also be thegoal of a six primary system. However, the six primary system should usewide bandwidth spectral output to minimize any metamerism issues. ITU-RBT.2020 defines various aspects of ultra-high-definition television(UHDTV) with standard dynamic range (SDR) and wide color gamut (WCG),including picture resolutions, frame rates with progressive scan, bitdepths, color primaries, RGB, luma-chroma color representations, chromasub sampling, and an opto-electronic transfer function. The ITU-RBT.2020 color space can reproduce colors that cannot be shown with ITU-RBT.709 (HDTV) color space. The RGB primaries used by ITU-R BT.2020 areequivalent to monochromatic light sources on the CIE 1931 spectrallocus.

FIG. 7 illustrates a comparison of the ITU-R BT.709-6 color gamut to thePointer data set of real-world surface colors. ITU-R BT.709-6 is themaximum gamut that can currently be displayed using the most broadstandard spectral emission primaries, and thus minimizes metamericissues. FIG. 7 also shows that a significant portion of the Pointer dataset is not covered by the ITU-R BT.709-6 standard. ITU-R BT.709standardizes the format of high-definition television (HDTV), having a16:9 (widescreen) aspect ratio. ITU-R BT.709 refers to HDTV systemshaving roughly two million luma samples per frame. ITU-R BT.709 has twoparts. Part 1 codifies what are now referred to as 1035i30 and 1152i25HDTV systems. The 1035i30 system is now obsolete, having been supersededby 1080i and 1080p square-sampled (“square-pixel”) systems. The 1152i25system was used for experimental equipment and was never commerciallydeployed. Part 2 codifies current and prospective 1080i and 1080psystems with square sampling by defining a common image format (CIF)with picture parameters independent of the picture rate.

A six-primary color system offers enhancements to the current RGBsystems. It extends current color gamuts to a wider usable color gamutthan currently offered and minimizes metamerisms (i.e., everyone seesthe same color). By doubling the number of primaries, and making theprimaries wide spectrum rather than narrow, viewer metameric errors arereduced.

In one embodiment, the six-primary color system is based on the ITU-RBT.709-6 color system. The ITU-R BT.709-6 color system offers the leastamount of metameric errors due to its limited gamut requirement. Inaddition, the ITU-R BT.709-6 color system makes use of wide spectralenergies, resulting in a more consistent color sensation from viewer toviewer. A six-primary color system using the ITU-R BT.709-6 color systemrequires three additional primary colors: Cyan (C), Yellow (Y), andMagenta (M). It is important to match these additional color primariesto an equal saturation level and to be at complementary wavelengths tothe original ITU-R BT.709-6 RGB and SMPTE RP431-2 RGB primary colors.

In addition, ITU-R BT.709-6 supports picture scanning characteristicsincluding, but not limited to, an order of sample presentation in ascanned system, a total number of lines, field frequency, framefrequency, segment frequency, interlace ratio, picture rate (Hz),samples per full line, nominal analogue signal bandwidths (MHz),sampling frequency (MHz) for RGBY, and/or sampling frequency (MHz) forCb Cr.

Saturation is defined between two coordinates, a white point and a colorprimary. Saturation is calculated as:S _(uv)=13[u′−u′ _(n))²+(v′−v′ _(n))²]^(1/2)wherein u′ and v′ reference coordinate points in a chromaticity diagram.In one embodiment, the chromaticity diagram is the Commission onIllumination (CIE) 1976 u′v′ chromaticity diagram.

In one embodiment, the white point for image is defined as the CIEStandard Illuminant D65 (D65). D65 is a commonly used standardilluminant and is part of the D series illuminants that attempt toportray standard illumination conditions at open-air in different partsof the world. D65 corresponds roughly to the average midday light inWestern and Northern Europe, comprised of both direct sunlight and thelight diffused by a clear sky. As any standard illuminant is representedas a table of averaged spectrophotometric data, any light source whichstatistically has the same relative spectral power distribution (SPD)can be considered a D65 light source. The D65 white point is used forITU-R BT.709. Alternatively, the white point is defined as a D60 whitepoint. The D60 white point is used for SMPTE RP431, which is discussedinfra.

Saturation values with a D65 white point are as follows:S _(Red)=3.3630315S _(Green)=1.5477145S _(Blue)=4.046013

The additional primaries for a six-primary color system using the ITU-RBT.709-6 color system are inverted and equidistant from the original RGBprimaries. In order to accomplish this, a hue rotation is necessary. Thehue rotation can be calculated as:h _(uv)=tan⁻¹(v*/u*)

Using the above hue rotation calculation, the following hue angles areproduced:H _(Red)=167.823°H _(Green)=52.2849°H _(Blue)=85.8743°Extending the hue angles to the opposite side of the gamut locus, andassigning a CYM (S_(CYM)) primary set at an equal saturation value to anopposing color (e.g., cyan equal to red, yellow equal to blue, magentaequal to green) results in a balanced six-color primary system.

In one embodiment, the six-primary color system is based on the ITU-RBT.2020 color system. The ITU-R BT.2020 color system is the currentstandardized wide gamut system. This standard assigns its colorprimaries to the edge of the 1931 standard observer locus. In asix-primary color system using this standard, the color primaries aresingle frequency emitters with frequencies centered at 630 nm (Red), 532nm (Green), and 467 nm (Blue). In another embodiment, the six-primarycolor system is based on the ITU-R BT.709 color system. In anotherembodiment, the six-primary color system is based a color system otherthan ITU-R BT.709 or ITU-R BT.2020.

FIG. 8 illustrates the ITU-R BT.709-6 color gamut with CYM hue anglesadded. In addition, a D65 white point is used for the additional hueangles. In another embodiment, the white point is a D60 white point.

FIG. 9 illustrates a RGBCYM system based on the ITU-R BT.709-6 colorsaturation (“6P-B”) shown over the Pointer data set of real colors. TheD65 white point is indicated by the red triangle. This RGBCYM systemcovers six primary colors, with hue angles for Yellow, Cyan, andMagenta. The biggest difference between this primary set and the primaryset of ITU-R BT.2020 is that the gamut shown as a six primary system isusing a wide bandwidth set of primaries.

FIG. 10A illustrates a six primary sample spectrum. FIG. 10B illustratesan RGBCYM system based on ITU-R BT.709 Color Saturation (6P-B). FIG. 10Cillustrates the ITU-R BT.2020 spectral recommendation. FIG. 10Dillustrates the ITU-R BT.2020 system. In one embodiment, the white pointis a D60 white point. In another embodiment, the white point is a D65white point.

FIG. 11 illustrates a RGBCYM system based on ITU-R BT.709 colorsaturation compared to ITU-R BT.2020. While the ITU-R BT.2020 systemcovers a larger volume, the six-primary color system benefits from amore repeatable color sensation between viewers. This repeatabilitymakes a six-primary color system advantageous over non six-primary colorsystems.

White Point Designation

With any three-primary color system, the white point is a separateconsideration regardless of color gamut. This is true in thatsaturation, dominant wavelength, and complementary wavelength aredefined between two coordinates, white point and color primary. In asix-primary color system, this becomes more complicated. Hue angles forCYM are provided as the inverse vector of RGB (180° hue angle).Therefore, saturation changes must be defined through a three-partcoordinate system. Additionally, in order for the system to functioncorrectly, the white point should lie on a line drawn between twoinverted primary colors. Thus, selection of D65 for an SMPTE RP431-2gamut will not track. The same is true if there is a need to use theSMPTE ST431-1 standard white point.

The Society of Motion Picture and Television Engineers (SMPTE) is aglobal professional association of engineers, technologists, andexecutives working in the media and entertainment industry. The SMPTEhas more than 800 standards, recommended practices, and engineeringguidelines for broadcast, filmmaking, digital cinema, audio recording,information technology (IT), and medical imaging.

Specific primary positions related to that white point are used toimplement this change. Each set of primaries now have a directcorresponding white point that is no longer a variable. There are threewhite points normally used for production. These are D65, D60, and thewhite point designated in SMPTE ST431-1. In another embodiment, thesystem uses a P3D65 white point. The SMPTE standard white point does nothave a CIE/ISO spectral description, only a coordinate designation. D65is described in spectral terms in CIE/ISO 11664-2 and formally in ISO10526-1991. D60 is derived by linear interpolation based on the D65spectral standard as:

${x_{D60} = {{0.2}44}},{{063} + {{0.0}9911\frac{10^{3}}{60}} + {2.967}},{{8\frac{10^{6}}{60^{2}}} - {{4.6}07}},{0\frac{10^{9}}{60^{3}}},{y_{D60} = {{{- {3.0}}00x_{D60}^{2}} + {{2.8}70x_{D60}} - {{0.2}75}}}$

These two white points are designated as D65 for television productionand D60 for film production. Thus, one separate set of color primariesis designated for each application and each system has one individualmatrix solution. TABLE 1 is the color space for D65 white point, whichassumes ITU-R BT.709 saturation. TABLE 2 is the color space for D60white point, which uses SMPTE RP431-2 saturation.

TABLE 1 Color space for D65 white point Color u′ v′ λ_(D) White 0.19780.4683 — Red 0.4507 0.5229 610 nm Green 0.125 0.5625 552 nm Blue 0.17540.1579 464 nm Yellow 0.204 0.565 571 nm Cyan 0.100 0.446 491 nm Magenta0.330 0.293 Combined red & blue

TABLE 2 Color space for D60 white point Color u′ v′ λ_(D) White 0.20100.4740 — Red 0.4964 0.5256 617 nm Green 0.0098 0.5777 543 nm Blue 0.17540.1579 464 nm Yellow 0.2078 0.5683 571 nm Cyan 0.0960 0.4540 492 nmMagenta 0.3520 0.3200 Combined red & blue

Super 6P

One of the advantages of ITU-R BT.2020 is that it can include all of thePointer colors and that increasing primary saturation in a six-colorprimary design could also do this. Pointer is described in “The Gamut ofReal Surface Colors, M.R. Pointer, Published in Colour Research andApplication Volume #5, Issue #3 (1980), which is incorporated herein byreference in its entirety. However, extending the 6P gamut beyond SMPTERP431-2 (“6P-C”) adds two problems. The first problem is the requirementto narrow the spectrum of the extended primaries. The second problem isthe complexity of designing a backwards compatible system using colorprimaries that are not related to current standards. But in some cases,there may be a need to extend the gamut beyond 6P-C and avoid theseproblems. If the goal is to encompass Pointer's data set, then it ispossible to keep most of the 6P-C system and only change the cyan colorprimary position. In one embodiment, the cyan color primary position islocated so that the gamut edge encompasses all of Pointer's data set. Inanother embodiment, the cyan color primary position is a location thatlimits maximum saturation. With 6P-C, cyan is positioned as u′=0.096,v′=0.454. In one embodiment of Super 6P, cyan is moved to u′=0.075,v′=0.430 (“Super 6Pa” (S6Pa)). Advantageously, this creates a new gamutthat covers Pointer's data set almost in its entirety as shown in FIG.98. Additionally, FIG. 106 illustrates Super 6Pa compared to 6P-C.

FIG. 107 is a table of values for Super 6Pa. The definition of X, Y, Zas well as x,y are described in ISO 11664-3:2012/CIE S 014 Part 3, whichis incorporated herein by reference in its entirety. The definition ofu′,v′ are described in ISO 11664-5:2016/CIE S 014 Part 5, which isincorporated herein by reference in its entirety. λ defines each colorprimary as dominant color wavelength for RGB and complementarywavelengths CMY.

In an alternative embodiment, the saturation is expanded on the same hueangle as 6P-C as shown in FIG. 99. Advantageously, this makes backwardcompatibility less complicated. However, this requires much moresaturation (i.e., narrower spectra). In another embodiment of Super 6P,cyan is moved to u′=0.067, v′=0.449 (“Super 6Pb” (S6Pb)). Additionally,FIG. 108 illustrates Super 6Pb compared to Super 6Pa and 6P-C.

FIG. 109 is a table of values for Super 6Pb. The definition of X, Y, Zas well as x,y are described in ISO 11664-3:2012/CIE S 014 Part 3, whichis incorporated herein by reference in its entirety. The definition ofu′,v′ are described in ISO 11664-5:2016/CIE S 014 Part 5, which isincorporated herein by reference in its entirety. λ defines each colorprimary as dominant color wavelength for RGB and complementarywavelengths CMY.

Adding Three More Color Primaries within SMPTE RP431-2 Spaces

In one embodiment, the system is designed using the saturation and huedesign from SMPTE RP431-2 (“6P-C”). What results is a system where thesaturation levels are equal to what is used for digital cinema. Both thecolor gamut and the white point require modification. Since the whitepoint is changed from D65 to D60, the saturation values and hue angleschange to the following:S _(RED)=3.90028 H _(RED)=170.160°S _(GREEN)=1.88941H _(GREEN)=45.3515°S _(BLUE)=4.12608 H _(BLUE)=85.4272°

FIG. 12 illustrates a comparison between ITU-R BT.709, SMPTE RP431-2,and ITU-R BT.2020 color gamuts. The illustration uses a D60 white pointvalue. In one embodiment, the six-primary color system uses a D65 whitepoint value.

FIG. 13 illustrates the Pointer color data set with a six-primary colorsystem based on SMPTE RP431-2 saturation and ITU-R BT.2020 superimposed.The red triangle is the white point, which is a D60 white point. Inanother embodiment, the white point is a D65 white point.

Transfer Functions

The system design minimizes limitations to use standard transferfunctions for both encode and/or decode processes. Current practicesused in standards include, but are not limited to, ITU-R BT.1886, ITU-RBT.2020, SMPTE ST274, SMPTE ST296, SMPTE ST2084, and ITU-R BT.2100.These standards are compatible with this system and require nomodification.

Encoding and decoding 6P images is formatted into several differentconfigurations to adapt to image transport frequency limitations. Thehighest quality transport is obtained by keeping all components asRGBCMY components. This uses the highest sampling frequencies andrequires the most signal bandwidth. An alternate method is to sum theimage details in a luminance channel at full bandwidth and then send thecolor difference signals at half or quarter sampling (e.g., Y Cr Cb CcCy). This allows a similar image to pass through lower bandwidthtransports.

Acquisition

The development of a six-primary color system is not practical if theonly part of the system that supports the added primaries is within thedisplay itself. There is a need for the ability to acquire, transport,and store images as a six-primary color system. One aspect that willsupport a six-primary color system is the camera.

In one embodiment, modifications are made to an existing wide gamutcamera. In one embodiment, RAW images are converted from an existingcamera to six channels. In one embodiment, optical modifications aremade to a single imager camera by using new filters. In anotherembodiment, signal inversion in a single imager camera is performed. Inanother embodiment, modifications are made to a six-imager camera.

FIG. 14 illustrates a system in which modifications have been made to anexisting wide gamut camera. The current large format single imagercamera sensors generally have capability to capture all colors that canbe seen by the human vision system, albeit with some error. This is doneusing wide bandpass optical filters combined with the design of theimager photoconductor. In this system, all six primary points arecovered by most acquisition technologies. Since these cameras supportingRAW output are already in use, they can serve as entry points intosix-primary color system workflows.

In one embodiment, the optical filter is an absorptive optical filter.Absorptive filters have a coating of different organic and inorganicmaterials that absorb certain wavelengths of light, thus allowing thedesired wavelengths to pass through. Since they absorb light energy, thetemperature of these filters increases during operation. Absorptivefilters are simple filters and are added to plastics to make less-costlyfilters than glass-based counterparts. The operation of absorptivefilters does not depend on the angle of the incident light but on theproperties of the material that makes up the filter.

In one embodiment, the optical filter is a dichroic filter. Dichroicfilters consist of a series of optical coatings with precise thicknessesthat are designed to reflect unwanted wavelengths and transmit thedesired wavelength range. This is achieved by causing the desiredwavelengths to interfere constructively on the transmission side of thefilter, while other wavelengths interfere constructively on thereflection side of the filter.

In one embodiment, the optical filter is a short pass filter. Short passfilters allow shorter wavelengths than the cut-off wavelength to passthrough, while it attenuates longer wavelengths. In one embodiment, theoptical filter is a long pass filter. Long pass filters transmit longerwavelengths than the cut-on wavelength while blocking shorterwavelengths. In another embodiment, the optical filter is a band passfilter. Band pass filters let a particular range, or “band”, ofwavelengths to go through, but attenuate all wavelengths around theband. In another embodiment, the optical filter is a multi-bandpassfilter. In another embodiment, the optical filter is a multi-banddichroic beam splitter.

In one embodiment, the optical filter is a neutral density (ND) filter.ND filters are used in imaging and laser applications where excessivelight can be damaging to camera sensors or other optical components. NDfilters also prevent excessive light from causing inaccurate results inphotometer applications.

In another embodiment, the optical filter is a machine vision filter.Machine vision filters are designed to improve image quality andcontrast in imaging and other machine vision applications. Machinevision filters are used to increase or decrease color temperature, blockunwanted ultraviolet or infrared light, reduce overall lighttransmittance, and transmit light of a specific polarization state.

In another embodiment, the optical filter is a notch filter. Notchfilters are used in spectroscopy, confocal and multi-photon microscopy,laser-based fluorescence instrumentation, and other life scienceapplications. Notch filters are filters that selectively reject aportion of the spectrum, while transmitting all other overallwavelengths.

FIG. 15 illustrates the workflow to use a six-primary color system usinga new input transfer transform. This new input transfer transform mapsthe full RAW signals down to six-primary color signals. In oneembodiment, RAW data captured from a wide gamut camera is received by anoutput transform, wherein the output transform maps the RAW data signalsdown to six-primary color signals.

Single imager camera systems typically use some modification of a Bayerpattern optical filter (CFA) to separate color. In one embodiment, astandard Bayer filter pattern is modified to include complementary colorprimaries (e.g., cyan, yellow, magenta). One implementation includes amagenta filter and is suited for 4:4:4 sampling systems. The other usesa sum of the blue and red filters to calculate a magenta color and isoptimized for 4:2:2 systems.

FIG. 16A and FIG. 16B illustrate the use of two mosaic filterconfigurations of the present invention. In one embodiment, a Bayerpattern optical filter modified using a magenta filter is used. Inanother embodiment, a Bayer pattern optical filter not using a magentafilter is used, wherein the magenta element will be calculated later inthe process by a serial data decoder. Difference in size of the yellowand green elements can be used to increase camera sensitivity.

FIG. 17 illustrates an expansion to the demuxing process to handle theplacement of additional color elements. The camera demuxing processhandles placement of the additional color elements by changing theimager timing generator and modifying demuxing switching at the imageroutput. Timing involves a simple sequence based on which color exitedthe imager and switching to the correct color processing path.

TABLE 3 compares the number of pixels required for different systems.

TABLE 3 H V Native Sub Bayer Sub System Resolution Resolution PixelCount Pixel Count 2K RGB 2048 1080 6,635,520 4,804,608 2K RGBCY 20481080 11,059,200 8,007,680 2K RGBCYM 2048 1080 12,509,184 9,609,216 4KRGB 4096 2160 26,542,080 19,906,560 4K RGBCY 4096 2160 44,236,80033,177,600 4K RGBCYM 4096 2160 53,084,160 39,813,120

Signal Inversion in a Single Imager Camera

FIG. 18 illustrates a signal inversion process in a single imagercamera. In some applications, the use of a low-cost, low-weight, and/orsmaller size camera is required. Devices included in these categoriesinclude, but are not limited to, home movies, a cell phone, a tabletcomputing device, and/or a remote camera. These applications have limitswhich do not support high-quality optics or processing. In oneembodiment, a six-primary color system for these applications invertsthe RGB signals, which become the CYM color components. In such anembodiment, all color components have equal saturation values and 180°hue angles. Issues with gamma tracking and white point designation areeliminated.

Six Imager Camera

In one embodiment, a device in network communication with multiplesensors is used. Situations requiring a device in network communicationwith multiple sensors include, but are not limited to, recording quickmovements within an image, high-speed photography, and/or recordingand/or capturing live events. The main component of such a system is aglass prism which distributes images from the lens to each sensor.

FIG. 19 illustrates a prism made up of three glass elements and twodichroic filters. In one embodiment, the glass prism is comprised ofthree glass elements and two dichroic filters. In one embodiment, theglass prism is comprised of three glass elements, two dichroic filters,and at least one trim filter, wherein the at least one trim filter ismounted in front of each sensor. TABLE 4 lists filters and operationsfor each filter as shown in FIG. 19.

TABLE 4 Filter Operation F1 Reflect and reject blue F2 Reflect andreject red F3 Trim red component F4 Trim green component F5 Trim bluecomponent

FIG. 20 illustrates a new prism design for a six-primary color system.The optics distribute six-primary color components without distortionand/or mirror artifacts. Reflections and/or flare within the glasselements are minimized, and light is passed through the prism moreefficiently than a traditional three-primary color system. The delay oflight passing through the new optical block is equal between colorpaths, minimizing any group delays. In one embodiment, the maindistribution optics is composed of a beam splitter cross prism. Faces ateach junction in the cube are half-mirrored to direct the image to atleast three outside flats.

Mounted to each of the at least three outside flats are a set of prismswhich, used in combination with at least one optical filter, distributelight to the correct sensor. Sensors are mounted to the output of theappropriate prism face. With this design, a full image is distributed toall six sensors. Three filters (F1, F5, and F9) are used to reject anypart of the spectrum not used by the related sensors. These are fairlywide in that each passes about ⅓^(rd) of the visual spectrum. Rejectionfilters (F2, F6, and F10) are used to split off the secondary color fromthe adjacent color primary. Trim filters (F3, F4, F7, F8, F11, and F12)are placed in front of each sensor to tune the spectrum for the correctresponse. TABLE 5 lists filters, colors, start, and stop for each filteras shown in FIG. 20.

TABLE 5 Filter Color Start Stop F1 R-Y 630 nm 540 nm F2 Y reject F3 RTrim 620 nm 600 nm F4 Y Trim 595 nm 545 nm F5 G-C 600 nm 470 nm F6 Cyanreject F7 G Trim 580 nm 540 nm F8 C Trim 535 nm 475 nm F9 M-B 510 nm 380nm F10 Magenta reject F11 B Trim 500 nm 435 nm F12 M Trim 445 nm 395 nm

In one embodiment, the set of prisms mounted to each of the at leastthree outside flats are a set of dichroic prisms. In another embodiment,the set of prisms mounted to each of the at least three outside flatsare a set of trichroic prisms.

Nomenclature

In one embodiment, a standard video nomenclature is used to betterdescribe each system.

R describes red data as linear light. G describes green data as linearlight. B describes blue data as linear light. C describes cyan data aslinear light. M describes magenta data as linear light. Y^(c) and/or Ydescribe yellow data as linear light.

R′ describes red data as non-linear light. G′ describes green data asnon-linear light. B′ describes blue data as non-linear light. C′describes cyan data as non-linear light. M′ describes magenta data asnon-linear light. Y^(c)′ and/or Y′ describe yellow data as non-linearlight.

Y₆ describes the luminance sum of RGBCMY data. Y_(RGB) describes asystem 2 encode that is the linear luminance sum of the RGB data.Y_(CMY) describes a system 2 encode that is the linear luminance sum ofthe CMY data.

C_(R) describes the data value of red after subtracting linear imageluminance. C_(B) describes the data value of blue after subtractinglinear image luminance. C_(C) describes the data value of cyan aftersubtracting linear image luminance. C_(Y) describes the data value ofyellow after subtracting linear image luminance.

Y′_(RGB) describes a system 2 encode that is the nonlinear luminance sumof the RGB data. Y′_(CMY) describes a system 2 encode that is thenonlinear luminance sum of the CMY data. −Y describes the sum of RGBdata subtracted from Y₆.

C′_(R) describes the data value of red after subtracting nonlinear imageluminance. C′_(B) describes the data value of blue after subtractingnonlinear image luminance. C′_(C) describes the data value of cyan aftersubtracting nonlinear image luminance. C′_(Y) describes the data valueof yellow after subtracting nonlinear image luminance.

B+Y describes a system 1 encode that includes either blue or yellowdata. G+M describes a system 1 encode that includes either green ormagenta data. R+C describes a system 1 encode that includes either greenor magenta data.

C_(R)+C_(C) describes a system 1 encode that includes either colordifference data. C_(B)+C_(Y) describes a system 1 encode that includeseither color difference data.

4:4:4 describes full bandwidth sampling of a color in an RGB system.4:4:4:4:4:4 describes full sampling of a color in an RGBCMY system.4:2:2 describes an encode where a full bandwidth luminance channel (Y)is used to carry image detail and the remaining components are halfsampled as a Cb Cr encode. 4:2:2:2:2 describes an encode where a fullbandwidth luminance channel (Y) is used to carry image detail and theremaining components are half sampled as a Cb Cr Cy Cc encode. 4:2:0describes a component system similar to 4:2:2, but where Cr and Cbsamples alternate per line. 4:2:0:2:0 describes a component systemsimilar to 4:2:2, but where Cr, Cb, Cy, and Cc samples alternate perline.

Constant luminance is the signal process where luminance (Y) arecalculated in linear light. Non-constant luminance is the signal processwhere luminance (Y) are calculated in nonlinear light.

Deriving Color Components

When using a color difference method (4:2:2), several components needspecific processing so that they can be used in lower frequencytransports. These are derived as:

Y₆^(′) = 0.1063R^(′) + 0.23195Y^(c^(′)) + 0.3576G^(′) + 0.19685C^(′) + 0.0361B^(′) + 0.0712M^(′)$G_{6}^{\prime} = {{( \frac{1}{{0.3}576Y} ) - ( {{0.1}063R^{\prime}} ) - ( {{0.0}361B^{\prime}} ) - ( {{0.1}9685C^{\prime}} ) - ( {{0.2}3195Y^{C^{\prime}}} ) - ( {0.0712M^{\prime}} )\mspace{20mu} - Y^{\prime}} = {Y_{6}^{\prime} - ( {C^{\prime} + Y^{c^{\prime}} + M^{\prime}} )}}$$\mspace{20mu}{C_{R}^{\prime} = {{\frac{R^{\prime} - Y_{6}^{\prime}}{{1.7}874}\mspace{14mu} C_{B}^{\prime}} = {{\frac{B^{\prime} - Y_{6}^{\prime}}{{1.9}278}\mspace{14mu} C_{C}^{\prime}} = {{\frac{C^{\prime} - Y_{6}^{\prime}}{1.6063}\mspace{14mu} C_{Y}^{\prime}} = \frac{Y^{C^{\prime}} - Y_{6}^{\prime}}{{1.5}361}}}}}$$\mspace{20mu}{R^{\prime} = {{\frac{C_{R}^{\prime} - Y_{6}^{\prime}}{{1.7}874}\mspace{14mu} B^{\prime}} = {{\frac{C_{B}^{\prime} - Y_{6}^{\prime}}{1.9278}\mspace{14mu} C^{\prime}} = {{\frac{C_{C}^{\prime} - Y_{6}^{\prime}}{{1.6}063}\mspace{14mu} Y^{C^{\prime}}} = \frac{C_{Y}^{\prime} - Y_{6}^{\prime}}{{1.5}361}}}}}$

The ratios for Cr, Cb, Cc, and Cy are also valid in linear lightcalculations.

Magenta can be calculated as follows:

$M^{\prime} = {{\frac{B^{\prime} + R^{\prime}}{B^{\prime} \times R^{\prime}}\mspace{14mu}{or}\mspace{14mu} M} = \frac{B + R}{B \times R}}$

Packaging and Mapping Six Color Primaries

In one embodiment, the six-primary color system is compatible withlegacy systems. A backwards compatible six-primary color system isdefined by a sampling method. In one embodiment, the sampling method is4:4:4. In one embodiment, the sampling method is 4:2:2. In anotherembodiment, the sampling method is 4:2:0. In one embodiment of abackwards compatible six-primary color system, new encode and decodesystems are divided into the steps of performing base encoding anddigitization, image data stacking, mapping into the standard datatransport, readout, unstacking, and image decoding (“System 1”). System1 combines opposing color primaries within three standard transportchannels and identifies them by their code value. In one embodiment of abackwards compatible six-primary color system, the processes are analogprocesses. In another embodiment of a backwards compatible six-primarycolor system, the processes are digital processes.

In one embodiment, the sampling method for a six-primary color system isa 4:4:4 sampling method. Black and white bits are redefined. Puttingblack at midlevel within each data word allows the addition of CYM colordata.

FIG. 21 illustrates an embodiment of an encode and decode system for asix-primary color system. In one embodiment, the six-primary colorsystem encode and decode system is divided into a base encoder anddigitation, image data stacking, mapping into the standard datatransport, readout, unstack, and finally image decoding (“System 1”).The method of this system combines opposing color primaries within thethree standard transport channels and identifies them by their codevalue. In one embodiment, the encode and decode for a six-primary colorsystem are analog-based. In another embodiment, the encode and decodefor a six-primary color system are digital-based. System 1 is designedto be compatible with lower bandwidth systems and allows a maximum of 11bits per channel and is limited to sending only three channels of thesix at a time. It does this by using a stacking system where either thecolor channel or the complementary channel is decoded depending on thebit level of that one channel.

FIG. 22 illustrates a sequential method where three color primaries arepassed to the transport format as full bit level image data and insertedas normal (“System 2”). The three additional channels are delayed by onepixel and then placed into the transport instead of the first colors.This method is useful in situations where quantizing artifacts iscritical to image performance. In one embodiment, this system iscomprised of six primaries (RGBCYM), a method to delay the CYM colorsfor injection, image resolution identification to all for pixel countsynchronization, start of video identification, RGB delay, and forYCCCCC systems, logic to select the dominant color primary. Theadvantage of System 2 is that full bit level video can be transported,but at double the normal data rate.

Six-Primary Color Encode Using a 4:4:4 Sampling Method

FIG. 23 illustrates one embodiment of a six-primary color system encodeusing a 4:4:4 sampling method.

Subjective testing during the development and implementation of thecurrent digital cinema system (DCI Version 1.2) showed that perceptiblequantizing artifacts were not noticeable with system bit resolutionshigher than 11 bits. Current serial digital transport systems support 12bits. Remapping six color components to a 12-bit stream is accomplishedby lowering the bit limit to 11 bits (values 0 to 2047) for 12-bitserial systems or 9 bits (values 0 to 512) for 10-bit serial systems.This process is accomplished by processing RGBCYM video informationthrough a standard Optical Electronic Transfer Function (OETF) (e.g.,ITU-R BT.709-6), digitizing the video information as four samples perpixel, and quantizing the video information as 11-bit or 9-bit.

In another embodiment, the RGBCYM video information is processed througha standard Optical Optical Transfer Function (OOTF). In yet anotherembodiment, the RGBCYM video information is processed through a TransferFunction (TF) other than OETF or OOTF. TFs consist of two components, aModulation Transfer Function (MTF) and a Phase Transfer Function (PTF).The MTF is a measure of the ability of an optical system to transfervarious levels of detail from object to image. In one embodiment,performance is measured in terms of contrast (degrees of gray), or ofmodulation, produced for a perfect source of that detail level. The PTFis a measure of the relative phase in the image(s) as a function offrequency. A relative phase change of 180°, for example, indicates thatblack and white in the image are reversed. This phenomenon occurs whenthe TF becomes negative.

There are several methods for measuring MTF. In one embodiment, MTF ismeasured using discrete frequency generation. In one embodiment, MTF ismeasured using continuous frequency generation. In another embodiment,MTF is measured using image scanning. In another embodiment, MTF ismeasured using waveform analysis.

In one embodiment, the six-primary color system is for a 12-bit serialsystem. Current practices normally set black at bit value 0 and white atbit value 4095 for 12-bit video. In order to package six colors into theexisting three-serial streams, the bit defining black is moved to bitvalue 2048. Thus, the new encode has RGB values starting at bit value2048 for black and bit value 4095 for white and CYM values starting atbit value 2047 for black and bit value 0 as white. In anotherembodiment, the six-primary color system is for a 10-bit serial system.

FIG. 24 illustrates one embodiment for a method to package six channelsof primary information into the three standard primary channels used incurrent serial video standards by modifying bit numbers for a 12-bit SDIand a 10-bit SDI. FIG. 25 illustrates a simplified diagram estimatingperceived viewer sensation as code values define each hue angle. TABLE 6and TABLE 7 list bit assignments for computer, production, and broadcastfor a 12-bit system and a 10-bit system, respectively. In oneembodiment, “Computer” refers to bit assignments compatible with CTA861-G, November 2016, which is incorporated herein by reference in itsentirety. In one embodiment, “Production” and/or “Broadcast” refer tobit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST 2082-1(2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11 (2016), SMPTE ST2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTEST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018),and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein byreference in its entirety.

TABLE 6 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYMRGB CYM Peak Brightness 4095 0 4076 16 3839 256 Minimum Brightness 20482047 2052 2032 2304 1792

TABLE 7 10-Bit Assignments Computer Production Broadcast RGB CYM RGB CYMRGB CYM Peak Brightness 1023 0 1019 4 940 64 Minimum Brightness 512 511516 508 576 448

In one embodiment, the OETF process is defined in ITU-R BT.709-6, whichis incorporated herein by reference in its entirety. In one embodiment,the OETF process is defined in ITU-R BT.709-5, which is incorporatedherein by reference in its entirety. In another embodiment, the OETFprocess is defined in ITU-R BT.709-4, which is incorporated herein byreference in its entirety. In yet another embodiment, the OETF processis defined in ITU-R BT.709-3, which is incorporated herein by referencein its entirety. In yet another embodiment, the OETF process is definedin ITU-R BT.709-2, which is incorporated herein by reference in itsentirety. In yet another embodiment, the OETF process is defined inITU-R BT.709-1, which is incorporated herein by reference in itsentirety.

In one embodiment, the encoder is a non-constant luminance encoder. Inanother embodiment, the encoder is a constant luminance encoder.

Six-Primary Color Packing/Stacking Using a 4:4:4 Sampling Method

FIG. 26 illustrates one embodiment for a method of stacking/encodingsix-primary color information using a 4:4:4 video system. Image datamust be assembled according the serial system used. This is not aconversion process, but instead is a packing/stacking process. In oneembodiment, the packing/stacking process is for a six-primary colorsystem using a 4:4:4 sampling method.

FIG. 27 illustrates one embodiment for a method of unstacking/decodingsix-primary color information using a 4:4:4 video system. In oneembodiment, the RGB channels and the CYM channels are combined into one12-bit word and sent to a standardized transport format. In oneembodiment, the standardized transport format is SMPTE ST424 SDI. In oneembodiment, the decode is for a non-constant luminance, six-primarycolor system. In another embodiment, the decode is for a constantluminance, six-primary color system. In yet another embodiment, anelectronic optical transfer function (EOTF) (e.g., ITU-R BT.1886)coverts image data back to linear for display. In one embodiment, theEOTF is defined in ITU-R BT.1886 (2011), which is incorporated herein byreference in its entirety. FIG. 28 illustrates one embodiment of a 4:4:4decoder.

System 2 uses sequential mapping to the standard transport format, so itincludes a delay for the CYM data. The CYM data is recovered in thedecoder by delaying the RGB data. Since there is no stacking process,the full bit level video can be transported. For displays that are usingoptical filtering, this RGB delay could be removed and the process ofmapping image data to the correct filter could be eliminated by assumingthis delay with placement of the optical filter and the use ofsequential filter colors.

Two methods can be used based on the type of optical filter used. Sincethis system is operating on a horizontal pixel sequence, some verticalcompensation is required and pixels are rectangular. This can be eitheras a line double repeat using the same RGBCYM data to fill the followingline as shown in FIG. 93, or could be separated as RGB on line one andCYM on line two as shown in FIG. 94. The format shown in FIG. 94 allowsfor square pixels, but the CMY components requires a line delay forsynchronization. Other patterns eliminating the white subpixel are alsocompatible with the present invention.

FIG. 29 illustrates an embodiment of the present invention for sendingsix primary colors to a standardized transport format using a 4:4:4encoder according to System 2. Encoding is straight forward with a pathfor RGB sent directly to the transport format. RGB data is mapped toeach even numbered data segment in the transport. CYM data is mapped toeach odd numbered segment. Because different resolutions are used in allof the standardized transport formats, there must be identification forwhat they are so that the start of each horizontal line and horizontalpixel count can be identified to time the RGB/CYM mapping to thetransport. The identification is the same as currently used in eachstandardized transport function. TABLE 8, TABLE 9, TABLE 10, and TABLE11 list 16-bit assignments, 12-bit assignments, 10-bit assignments, and8-bit assignments, respectively. In one embodiment, “Computer” refers tobit assignments compatible with CTA 861-G, November 2016, which isincorporated herein by reference in its entirety. In one embodiment,“Production” and/or “Broadcast” refer to bit assignments compatible withSMPTE ST 2082-0 (2016), SMPTE ST 2082-1 (2015), SMPTE ST 2082-10 (2015),SMPTE ST 2082-11 (2016), SMPTE ST 2082-12 (2016), SMPTE ST 2110-10(2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST2110-30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-40 (2018),each of which is incorporated herein by reference in its entirety.

TABLE 8 16-Bit Assignments Computer Production RGB CYM RGB CYM PeakBrightness 65536 65536 65216 65216 Minimum Brightness 0 0 256 256

TABLE 9 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYMRGB CYM Peak Brightness 4095 4095 4076 4076 3839 3839 Minimum Brightness0 0 16 16 256 256

TABLE 10 10-Bit Assignments Computer Production Broadcast RGB CYM RGBCYM RGB CYM Peak Brightness 1023 1023 1019 1019 940 940 MinimumBrightness 0 0 4 4 64 64

TABLE 11 8-Bit Assignments Computer Production Broadcast RGB CYM RGB CYMRGB CYM Peak Brightness 255 255 254 254 235 235 Minimum Brightness 0 0 11 16 16

The decode adds a pixel delay to the RGB data to realign the channels toa common pixel timing. EOTF is applied and the output is sent to thenext device in the system. Metadata based on the standardized transportformat is used to identify the format and image resolution so that theunpacking from the transport can be synchronized. FIG. 30 shows oneembodiment of a decoding with a pixel delay.

In one embodiment, the decoding is 4:4:4 decoding. With this method, thesix-primary color decoder is in the signal path, where 11-bit values forRGB are arranged above bit value 2048, while CYM levels are arrangedbelow bit value 2047 as 11-bit. If the same data set is sent to adisplay and/or process that is not operable for six-primary colorprocessing, the image data is assumed as black at bit value 0 as a full12-bit word. Decoding begins by tapping image data prior to theunstacking process.

Six-Primary Color Encode Using a 4:2:2 Sampling Method

In one embodiment, the packing/stacking process is for a six-primarycolor system using a 4:2:2 sampling method. In order to fit the newsix-primary color system into a lower bandwidth serial system, whilemaintaining backwards compatibility, the standard method of convertingfrom RGBCYM to a luminance and a set of color difference signalsrequires the addition of at least one new image designator. In oneembodiment, the encoding and/or decoding process is compatible withtransport through SMPTE ST 292-0 (2011), SMPTE ST 292-1 (2011, 2012,and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-1 (2007), SMPTE ST2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTE ST2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7(2013), and/or and CTA 861-G (2106), each of which is incorporatedherein by reference in its entirety.

In order for the system to package all of the image while supportingboth six-primary and legacy displays, an electronic luminance component(Y) must be derived. The first component is: E′_(Y) ₆ . It can bedescribed as:E′ _(Y) ₆ =0.1063E′ _(Red)+0.231954E′ _(Yellow)+0.3576E′_(Green)+0.19685E′ _(Cyan)+0.0361E′ _(Blue)+0.0712E′ _(Magenta)

Critical to getting back to legacy display compatibility, value E′_(−Y)is described as:E′ _(−Y) =E′ _(Y) ₆ −(E′ _(Cyan) +E′ _(Yellow) +E′ _(Magenta))

In addition, at least two new color components are disclosed. These aredesignated as Cc and Cy components. The at least two new colorcomponents include a method to compensate for luminance and enable thesystem to function with older Y Cb Cr infrastructures. In oneembodiment, adjustments are made to Cb and Cr in a Y Cb Crinfrastructure since the related level of luminance is operable fordivision over more components. These new components are as follows:

${E_{CR}^{\prime} = \frac{( {E_{R}^{\prime} - E_{Y_{6}}^{\prime}} )}{1.7874}},{E_{CB}^{\prime} = \frac{( {E_{B}^{\prime} - E_{Y_{6}}^{\prime}} )}{1.9278}},{E_{CC}^{\prime} = \frac{( {E_{C}^{\prime} - E_{Y_{6}}^{\prime}} )}{1.6063}},{E_{CY}^{\prime} = \frac{( {E_{Y}^{\prime} - E_{Y_{6}}^{\prime}} )}{1.5361}}$

Within such a system, it is not possible to define magenta as awavelength. This is because the green vector in CIE 1976 passes into,and beyond, the CIE designated purple line. Magenta is a sum of blue andred. Thus, in one embodiment, magenta is resolved as a calculation, notas optical data. In one embodiment, both the camera side and the monitorside of the system use magenta filters. In this case, if magenta weredefined as a wavelength, it would not land at the point described.Instead, magenta would appear as a very deep blue which would include anarrow bandwidth primary, resulting in metameric issues from usingnarrow spectral components. In one embodiment, magenta as an integervalue is resolved using the following equation:

$M_{INT} = \lbrack \frac{\frac{B_{INT}}{2} + \frac{R_{INT}}{2}}{2} \rbrack$The above equation assists in maintaining the fidelity of a magentavalue while minimizing any metameric errors. This is advantageous overprior art, where magenta appears instead as a deep blue instead of theintended primary color value.

Six-Primary Non-Constant Luminance Encode Using a 4:2:2 Sampling Method

In one embodiment, the six-primary color system using a non-constantluminance encode for use with a 4:2:2 sampling method. In oneembodiment, the encoding process and/or decoding process is compatiblewith transport through SMPTE ST 292-0 (2011), SMPTE ST 292-1 (2011,2012, and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-1 (2007), SMPTEST 2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTEST 2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7(2013), and/or and CTA 861-G (2106), each of which is incorporatedherein by reference in its entirety.

Current practices use a non-constant luminance path design, which isfound in all the video systems currently deployed. FIG. 31 illustratesone embodiment of an encode process for 4:2:2 video for packaging fivechannels of information into the standard three-channel designs. For4:2:2, a similar method to the 4:4:4 system is used to package fivechannels of information into the standard three-channel designs used incurrent serial video standards. FIG. 31 illustrates 12-bit SDI and10-bit SDI encoding for a 4:2:2 system. TABLE 12 and TABLE 13 list bitassignments for a 12-bit and 10-bit system, respectively. In oneembodiment, “Computer” refers to bit assignments compatible with CTA861-G, November 2016, which is incorporated herein by reference in itsentirety. In one embodiment, “Production” and/or “Broadcast” refer tobit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST 2082-1(2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11 (2016), SMPTE ST2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTEST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018),and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein byreference in its entirety.

TABLE 12 12-Bit Assignments Computer Production Broadcast EY₆ EC_(R),EC_(B) EC_(C), EC_(Y) EY₆ EC_(R), EC_(B) EC_(C), EC_(Y) EY₆ EC_(R),EC_(B) EC_(C), EC_(Y) Peak Brightness 4095 4095 0 4076 4076 16 3839 3839256 Minimum Brightness 0 2048 2047 16 2052 2032 256 2304 1792

TABLE 13 10-Bit Assignments Computer Production Broadcast EY₆ EC_(R),EC_(B) EC_(C), EC_(Y) EY₆ EC_(R), EC_(B) EC_(C), EC_(Y) EY₆ EC_(R),EC_(B) EC_(C), EC_(Y) Peak Brightness 1023 1023 0 1019 1019 4 940 940 64Minimum Brightness 0 512 511 4 516 508 64 576 448

FIG. 32 illustrates one embodiment for a non-constant luminance encodingprocess for a six-primary color system. The design of this process issimilar to the designs used in current RGB systems. Input video is sentto the Optical Electronic Transfer Function (OETF) process and then tothe E_(Y) ₆ encoder. The output of this encoder includes all of theimage detail information. In one embodiment, all of the image detailinformation is output as a monochrome image.

The output is then subtracted from E′_(R), E′_(B), E′_(C), and E′_(Y) tomake the following color difference components:

-   -   E′_(CR), E′_(CB), E′_(CC), E′_(CY)        These components are then half sampled (x2) while E′_(Y) ₆ is        fully sampled (x4).

FIG. 33 illustrates one embodiment of a packaging process for asix-primary color system. These components are then sent to thepacking/stacking process. Components E′_(CY-INT) and E′_(CC-INT) areinverted so that bit 0 now defines peak luminance for the correspondingcomponent. In one embodiment, this is the same packaging processperformed with the 4:4:4 sampling method design, resulting in two 11-bitcomponents combining into one 12-bit component.

Six-Primary Non-Constant Luminance Decode Using a 4:2:2 Sampling Method

FIG. 34 illustrates a 4:2:2 unstack process for a six-primary colorsystem. In one embodiment, the image data is extracted from the serialformat through the normal processes as defined by the serial data formatstandard. In another embodiment, the serial data format standard uses a4:2:2 sampling structure. In yet another embodiment, the serial dataformat standard is SMPTE ST292. The color difference components areseparated and formatted back to valid 11-bit data. ComponentsE′_(CY-INT) and E′_(CY-INT) are inverted so that bit value 2047 definespeak color luminance.

FIG. 35 illustrates one embodiment of a process to inversely quantizeeach individual color and pass the data through an electronic opticalfunction transfer (EOTF) in a non-constant luminance system. Theindividual color components, as well as E′_(Y) ₆ _(-INT) are inverselyquantized and summed to breakout each individual color. Magenta is thencalculated and E′_(Y) ₆ _(-INT) is combined with these colors to resolvegreen. These calculations then go back through an Electronic OpticalTransfer Function (EOTF) process to output the six-primary color system.

In one embodiment, the decoding is 4:2:2 decoding. This decode followsthe same principles as the 4:4:4 decoder. However, in 4:2:2 decoding, aluminance channel is used instead of discrete color channels. Here,image data is still taken prior to unstack from theE′_(CB-INT)+E′_(CY-INT) and E′_(CR-INT)+E′_(CC-INT) channels. With a4:2:2 decoder, a new component, called E′_(−Y), is used to subtract theluminance levels that are present from the CYM channels from theE′_(CB-INT)+E′_(CY-INT) and E′_(CR-INT)+E′_(CC-INT) components. Theresulting output is now the R and B image components of the EOTFprocess. E′_(−Y) is also sent to the G matrix to convert the luminanceand color difference components to a green output. Thus, R′G′B′ is inputto the EOTF process and output as G_(RGB), R_(RGB), and B_(RGB). Inanother embodiment, the decoder is a legacy RGB decoder for non-constantluminance systems.

In one embodiment, the standard is SMPTE ST292. In one embodiment, thestandard is SMPTE RP431-2. In one embodiment, the standard is ITU-RBT.2020. In another embodiment, the standard is SMPTE RP431-1. Inanother embodiment, the standard is ITU-R BT.1886. In anotherembodiment, the standard is SMPTE ST274. In another embodiment, thestandard is SMPTE ST296. In another embodiment, the standard is SMPTEST2084. In yet another embodiment, the standard is ITU-R BT.2100. In yetanother embodiment, the standard is SMPTE ST424. In yet anotherembodiment, the standard is SMPTE ST425. In yet another embodiment, thestandard is SMPTE ST2110.

Six-Primary Constant Luminance Decode Using a 4:2:2 Sampling Method

FIG. 36 illustrates one embodiment of a constant luminance encode for asix-primary color system. FIG. 37 illustrates one embodiment of aconstant luminance decode for a six-primary color system. The processfor constant luminance encode and decode are very similar. The maindifference being that the management of E_(Y) ₆ is linear. The encodeand decode processes stack into the standard serial data streams in thesame way as is present in a non-constant luminance, six-primary colorsystem. In one embodiment, the stacker design is the same as with thenon-constant luminance system.

System 2 operation is using a sequential method of mapping to thestandard transport instead of the method in System 1 where pixel data iscombined to two color primaries in one data set as an 11-bit word. Theadvantage of System 1 is that there is no change to the standardtransport. The advantage of System 2 is that full bit level video can betransported, but at double the normal data rate.

The difference between the systems is the use of two Y channels inSystem 2. Y_(RGB) and Y_(CYM) are used to define the luminance value forRGB as one group and CYM for the other.

FIG. 38 illustrates one example of 4:2:2 non-constant luminanceencoding. Because the RGB and CYM components are mapped at differenttime intervals, there is no requirement for a stacking process and datais fed directly to the transport format. The development of the separatecolor difference components is identical to System 1.

The encoder for System 2 takes the formatted color components in thesame way as System 1. Two matrices are used to build two luminancechannels. Y_(RGB) contains the luminance value for the RGB colorprimaries. Y_(CYM) contains the luminance value for the CYM colorprimaries. A set of delays are used to sequence the proper channel forY_(RGB), Y_(CMY), and the RBCY channels. Because the RGB and CYMcomponents are mapped at different time intervals, there is norequirement for a stacking process, and data is fed directly to thetransport format. The development of the separate color differencecomponents is identical to System 1. The Encoder for System 2 takes theformatted color components in the same way as System 1. Two matrices areused to build two luminance channels: Y_(RGB) contains the luminancevalue for the RGB color primaries and Y_(CMY) contains the luminancevalue for the CMY color primaries. This sequences Y_(RGB), CR, and CCchannels into the even segments of the standardized transport andY_(CMY), CB, and CY into the odd numbered segments. Since there is nocombining color primary channels, full bit levels can be used limitedonly by the design of the standardized transport method. In addition,for use in matrix driven displays, there is no change to the inputprocessing and only the method of outputting the correct color isrequired if the filtering or emissive subpixel is also placedsequentially.

Timing for the sequence is calculated by the source format descriptorwhich then flags the start of video and sets the pixel timing.

FIG. 39 illustrates one embodiment of a non-constant luminance decodingsystem. Decoding uses timing synchronization from the format descriptorand start of video flags that are included in the payload ID, SDP, orEDID tables. This starts the pixel clock for each horizontal line toidentify which set of components are routed to the proper part of thedecoder. A pixel delay is used to realign the color primarily data ofeach subpixel. Y_(RGB) and Y_(CMY) are combined to assemble a new Y₆component which is used to decode the CR, CB, CC, CY, and CM componentsinto RGBCYM.

The constant luminance system is not different from the non-constantluminance system in regard to operation. The difference is that theluminance calculation is done as a linear function instead of includingthe OOTF. FIG. 40 illustrates one embodiment of a 4:2:2 constantluminance encoding system. FIG. 41 illustrates one embodiment of a 4:2:2constant luminance decoding system.

Six-Primary Color System Using a 4:2:0 Sampling System

In one embodiment, the six-primary color system uses a 4:2:0 samplingsystem. The 4:2:0 format is widely used in H.262/MPEG-2, H.264/MPEG-4Part 10 and VC-1 compression. The process defined in SMPTE RP2050-1provides a direct method to convert from a 4:2:2 sample structure to a4:2:0 structure. When a 4:2:0 video decoder and encoder are connectedvia a 4:2:2 serial interface, the 4:2:0 data is decoded and converted to4:2:2 by up-sampling the color difference component. In the 4:2:0 videoencoder, the 4:2:2 video data is converted to 4:2:0 video data bydown-sampling the color difference component.

There typically exists a color difference mismatch between the 4:2:0video data from the 4:2:0 video data to be encoded. Several stages ofcodec concatenation are common through the processing chain. As aresult, color difference signal mismatch between 4:2:0 video data inputto 4:2:0 video encoder and 4:2:0 video output from 4:2:0 video decoderis accumulated and the degradation becomes visible.

Filtering within a Six-Primary Color System Using a 4:2:0 SamplingMethod

When a 4:2:0 video decoder and encoder are connected via a serialinterface, 4:2:0 data is decoded and the data is converted to 4:2:2 byup-sampling the color difference component, and then the 4:2:2 videodata is mapped onto a serial interface. In the 4:2:0 video encoder, the4:2:2 video data from the serial interface is converted to 4:2:0 videodata by down-sampling the color difference component. At least one setof filter coefficients exists for 4:2:0/4:2:2 up-sampling and4:2:2/4:2:0 down-sampling. The at least one set of filter coefficientsprovide minimally degraded 4:2:0 color difference signals inconcatenated operations.

Filter Coefficients in a Six-Primary Color System Using a 4:2:0 SamplingMethod

FIG. 42 illustrates one embodiment of a raster encoding diagram ofsample placements for a six-primary color 4:2:0 progressive scan system.Within this compression process, horizontal lines show the raster on adisplay matrix. Vertical lines depict drive columns. The intersection ofthese is a pixel calculation. Data around a particular pixel is used tocalculate color and brightness of the subpixels. Each “X” showsplacement timing of the E_(Y) ₆ _(-INT) sample. Red dots depictplacement of the E′_(CR-INT)+E′_(CC-INT) sample. Blue triangles showplacement of the E′_(CB-INT)+E′_(CY-INT) sample.

In one embodiment, the raster is an RGB raster. In another embodiment,the raster is a RGBCYM raster.

System 3

FIG. 95 illustrates one embodiment of a system encode and decode processusing a dual link method (“System 3”). System 3 utilizes a dual linkmethod where two wires are used. RGB is sent to link A and CYM is sentto link B. After arriving at the image destination, the two links arerecombined.

System 3 is simpler and more straight forward than Systems 1 and 2. Theadvantage with this system is that adoption is simply to format CYM on asecond link. So, for an SDI design, RGB is sent on a standard SDI streamjust as it is currently done. There is no modification to the transportand this link is operable to be sent to any RGB display requiring onlythe compensation for the luminance difference because the CYM componentsare not included. CYM data is transported in the same manner as RGBdata. This data is then combined in the display to make up a 6P image.The downside is that the system requires two wires to move one image.This system is operable to work with most any format including SMPTEST292, 424, 2082, and 2110. It also is operable to work with dualHDMI/CTA connections. In one embodiment, the system includes at leastone transfer function (e.g., OETF, EOTF).

FIG. 96 illustrates one embodiment of an encoding process using a duallink method.

FIG. 97 illustrates one embodiment of a decoding process using a duallink method.

Comparison of Three Systems

Advantageously, System 1 fits within legacy SDI, CTA, and Ethernettransports. Additionally, System 1 has zero latency processing forconversion to an RGB display. However, System 1 is limited to 11-bitwords.

System 2 is advantageously operable to transport 6 channels using 16-bitwords with no compression. Additionally, System 2 fits within newer SDI,CTA, and Ethernet transport formats. However, System 2 requires doublebit rate speed. For example, a 4K image requires a data rate for an 8KRGB image.

In comparison, System 3 is operable to transport 6 channels using 16-bitwords with compression and at the same data required for a specificresolution. For example, a data rate for an RGB image is the same as fora 6P image using System 3. However, System 3 requires a twin cableconnection within the video system.

Six-Primary Color System Backwards Compatibility

By designing the color gamut within the saturation levels of standardformats and using inverse color primary positions, it is easy to resolvean RGB image with minimal processing. In one embodiment for six-primaryencoding, image data is split across three color channels in a transportsystem. In one embodiment, the image data is read as six-primary data.In another embodiment, the image data is read as RGB data. Bymaintaining a standard white point, the axis of modulation for eachchannel is considered as values describing two colors (e.g., blue andyellow) for a six-primary system or as a single color (e.g., blue) foran RGB system. This is based on where black is referenced. In oneembodiment of a six-primary color system, black is decoded at amid-level value. In an RGB system, the same data stream is used, butblack is referenced at bit zero, not a mid-level.

In one embodiment, the RGB values encoded in the 6P stream are based onITU-R BT.709. In another embodiment, the RGB values encoded are based onSMPTE RP431. Advantageously, these two embodiments require almost noprocessing to recover values for legacy display.

Two decoding methods are proposed. The first is a preferred method thatuses very limited processing, negating any issues with latency. Thesecond is a more straightforward method using a set of matrices at theend of the signal path to conform the 6P image to RGB.

In one embodiment, the decoding is for a 4:4:4 system. In oneembodiment, the assumption of black places the correct data with eachchannel. If the 6P decoder is in the signal path, 11-bit values for RGBare arranged above bit value 2048, while CYM level are arranged belowbit value 2047 as 11-bit. However, if this same data set is sent to adisplay or process that is does not understand 6P processing, then thatimage data is assumed as black at bit value 0 as a full 12-bit word.

FIG. 43 illustrates one embodiment of the six-primary color unstackprocess in a 4:2:2 video system. Decoding starts by tapping image dataprior to the unstacking process. The input to the 6P unstack will map asshown in FIG. 44. The output of the 6P decoder will map as shown in FIG.45. This same data is sent uncorrected as the legacy RGB image data. Theinterpretation of the RGB decode will map as shown in FIG. 46.

Alternatively, the decoding is for a 4:2:2 system. This decode uses thesame principles as the 4:4:4 decoder, but because a luminance channel isused instead of discrete color channels, the processing is modified.Legacy image data is still taken prior to unstack from theE′_(CB-INT)+E′_(CY-INT) and E′_(CR-INT)+E′_(CC-INT) channels as shown inFIG. 49.

FIG. 50 illustrates one embodiment of a non-constant luminance decoderwith a legacy process. The dotted box marked (1) shows the process wherea new component called E′_(−Y) is used to subtract the luminance levelsthat are present from the CYM channels from the E′_(CB-INT)+E′_(CY-INT)and E′_(CR-INT)+E′_(CC-INT) components as shown in box (2). Theresulting output is now the R and B image components of the EOTFprocess. E′_(−Y) is also sent to the G matrix to convert the luminanceand color difference components to a green output as shown in box (3).Thus, R′G′B′ is input to the EOTF process and output as G_(RGB),R_(RGB), and B_(RGB). In another embodiment, the decoder is a legacy RGBdecoder for non-constant luminance systems.

For a constant luminance system, the process is very similar with theexception that green is calculated as linear as shown in FIG. 51.

Six-Primary Color System Using a Matrix Output

In one embodiment, the six-primary color system outputs a legacy RGBimage. This requires a matrix output to be built at the very end of thesignal path. FIG. 52 illustrates one embodiment of a legacy RGB imageoutput at the end of the signal path. The design logic of the C, M, andY primaries is in that they are substantially equal in saturation andplaced at substantially inverted hue angles compared to R, G, and Bprimaries, respectively. In one embodiment, substantially equal insaturation refers to a ±10% difference in saturation values for the C,M, and Y primaries in comparison to saturation values for the R, G, andB primaries, respectively. In addition, substantially equal insaturation covers additional percentage differences in saturation valuesfalling within the ±10% difference range. For example, substantiallyequal in saturation further covers a ±7.5% difference in saturationvalues for the C, M, and Y primaries in comparison to the saturationvalues for the R, G, and B primaries, respectively; a ±5% difference insaturation values for the C, M, and Y primaries in comparison to thesaturation values for the R, G, and B primaries, respectively; a ±2%difference in saturation values for the C, M, and Y primaries incomparison to the saturation values for the R, G, and B primaries,respectively; a ±1% difference in saturation values for the C, M, and Yprimaries in comparison to the saturation values for the R, G, and Bprimaries, respectively; and/or a ±0.5% difference in saturation valuesfor the C, M, and Y primaries in comparison to the saturation values forthe R, G, and B primaries, respectively. In a preferred embodiment, theC, M, and Y primaries are equal in saturation to the R, G, and Bprimaries, respectively. For example, the cyan primary is equal insaturation to the red primary, the magenta primary is equal insaturation to the green primary, and the yellow primary is equal insaturation to the blue primary.

In an alternative embodiment, the saturation values of the C, M, and Yprimaries are not required to be substantially equal to their corollaryprimary saturation value among the R, G, and B primaries, but aresubstantially equal in saturation to a primary other than theircorollary R, G, or B primary value. For example, the C primarysaturation value is not required to be substantially equal in saturationto the R primary saturation value, but rather is substantially equal insaturation to the G primary saturation value and/or the B primarysaturation value. In one embodiment, two different color saturations areused, wherein the two different color saturations are based onstandardized gamuts already in use.

In one embodiment, substantially inverted hue angles refers to a ±10%angle range from an inverted hue angle (e.g., 180 degrees). In addition,substantially inverted hue angles cover additional percentagedifferences within the ±10% angle range from an inverted hue angle. Forexample, substantially inverted hue angles further covers a ±7.5% anglerange from an inverted hue angle, a ±5% angle range from an inverted hueangle, a ±2% angle range from an inverted hue angle, a ±1% angle rangefrom an inverted hue angle, and/or a ±0.5% angle range from an invertedhue angle. In a preferred embodiment, the C, M, and Y primaries areplaced at inverted hue angles (e.g., 180 degrees) compared to the R, G,and B primaries, respectively.

In one embodiment, the gamut is the ITU-R BT.709-6 gamut. In anotherembodiment, the gamut is the SMPTE RP431-2 gamut.

For simplicity, the 6P gamut based on ITU-R BT.709 saturation isreferred to as “6P-B”. The gamut based on SMPTE RP431-2 is referred toas “6P-C”. Referring back to the discussion on white point, 6P-Bspecifies a white point as D65 (ISO 11664-2). 6P-C preferably uses awhite point of D60 (SMPTE ST2065-1). Alternatively, 6P-C uses a whitepoint of D65. FIG. 110 is a table of values for 6P-B. FIG. 111illustrates 6P-B compared to ITU-R BT.709-6. FIG. 112 is a table ofvalues for 6P-C. FIG. 113 illustrates 6P-C compared to SMPTE RP431-2.TABLE 14 and TABLE 15 show a comparison between the 6P RGBCYM andrelated RGB color primary placements.

TABLE 14 6P-B ITU-R BT.709 u′ v′ u′ v′ White 0.1978 0.4683 0.1978 0.4683Red 0.4507 0.5229 0.4507 0.5229 Green 0.1250 0.5625 0.1250 0.5625 Blue0.1754 0.1579 0.1754 0.1579 Yellow 0.2040 0.5650 Cyan 0.1000 0.4460Magenta 0.3300 0.2930

TABLE 15 6P-C SMPTE RP431-2 u′ v′ u′ v′ White 0.2010 0.4740 0.20100.4740 Red 0.4964 0.5256 0.4964 0.5256 Green 0.098 0.5777 0.098 0.5777Blue 0.1754 0.1579 0.1754 0.1579 Yellow 0.2078 0.5683 Cyan 0.0960 0.4540Magenta 0.3520 0.3200

The unstack process includes output as six, 11-bit color channels thatare separated and delivered to a decoder. To convert an image from asix-primary color system to an RGB image, at least two matrices areused. One matrix is a 3×3 matrix converting a six-primary color systemimage to XYZ values. A second matrix is a 3×3 matrix for converting fromXYZ to the proper RGB color space. In one embodiment, XYZ valuesrepresent additive color space values, where XYZ matrices representadditive color space matrices. Additive color space refers to theconcept of describing a color by stating the amounts of primaries that,when combined, create light of that color.

When a six-primary display is connected to the six-primary output, eachchannel will drive each color. When this same output is sent to an RGBdisplay, the CYM channels are ignored and only the RGB channels aredisplayed. An element of operation is that both systems drive from theblack area. At this point in the decoder, all are coded as bit value 0being black and bit value 2047 being peak color luminance. This processcan also be reversed in a situation where an RGB source can feed asix-primary display. The six-primary display would then have noinformation for the CYM channels and would display the input in astandard RGB gamut. FIG. 47 illustrates one embodiment of six-primarycolor output using a non-constant luminance decoder. FIG. 48 illustratesone embodiment of a legacy RGB process within a six-primary colorsystem.

The design of this matrix is a modification of the CIE process toconvert RGB to XYZ. First, u′v′ values are converted back to CIE 1931xyz values using the following formulas:

$x = \frac{9u^{\prime}}{( {{6u^{\prime}} - {16v^{\prime}} + {12}} )}$$y = \frac{4v^{\prime}}{( {{6u^{\prime}} - {16v^{\prime}} + {12}} )}$z = 1 − x − y

Next, RGBCYM values are mapped to a matrix. The mapping is dependentupon the gamut standard being used. In one embodiment, the gamut isITU-R BT.709-6. The mapping for RGBCYM values for an ITU-R BT.709-6(6P-B) gamut are:

$\lbrack {\begin{pmatrix}\; & x & y & z \\R & 0.640 & 0.330 & 0.030 \\G & 0.300 & 0.600 & 0.100 \\B & 0.150 & 0.060 & 0.100 \\C & 0.439 & 0.540 & 0.021 \\Y & 0.165 & 0.327 & 0.509 \\M & 0.320 & 0.126 & 0.554\end{pmatrix}\begin{pmatrix}\; & R & G & B & C & Y & M \\x & {{0.6}40} & {{0.3}00} & {{0.1}50} & {{0.4}39} & {{0.1}65} & {{0.3}19} \\y & {{0.3}30} & {{0.6}00} & {{0.0}60} & {{0.5}40} & {{0.3}27} & {{0.1}26} \\z & {{0.0}30} & {{0.1}00} & {{0.7}90} & {{0.0}21} & {{0.5}09} & {{0.5}54}\end{pmatrix}} \rbrack = \mspace{160mu}\begin{pmatrix}{{0.5}19} & {{0.3}93} & {{0.1}40} \\{{0.3}93} & {{0.4}60} & {{0.1}60} \\{{0.1}40} & {{0.1}60} & {{0.6}50}\end{pmatrix}$

In one embodiment, the gamut is SMPTE RP431-2. The mapping for RGBCYMvalues for an SMPTE RP431-2 (6P-C) gamut are:

$\lbrack {\begin{pmatrix}\; & x & y & z \\R & 0.680 & 0.320 & 0.000 \\G & 0.264 & 0.691 & 0.045 \\B & 0.150 & 0.060 & 0.790 \\C & 0.450 & 0.547 & 0.026 \\Y & 0.163 & 0.342 & 0.496 \\M & 0.352 & 0.142 & 0.505\end{pmatrix}\begin{pmatrix}\; & R & G & B & C & Y & M \\x & {{0.6}80} & {{0.2}64} & {{0.1}50} & {{0.4}50} & {{0.1}63} & {{0.3}52} \\y & {{0.3}20} & {{0.6}90} & {{0.0}60} & {{0.5}47} & {{0.3}42} & {{0.1}42} \\z & {{0.0}00} & {{0.0}45} & {{0.7}90} & {{0.0}26} & {{0.4}96} & {{0.5}05}\end{pmatrix}} \rbrack = \mspace{160mu}\begin{pmatrix}{{0.5}65} & {{0.4}00} & {{0.1}21} \\{{0.4}00} & {{0.5}49} & {{0.1}17} \\{{0.1}21} & {{0.1}17} & {{0.6}50}\end{pmatrix}$

Following mapping the RGBCYM values to a matrix, a white pointconversion occurs:

$X = {{\frac{x}{y}\mspace{14mu} Y} = {{1\mspace{14mu} Z} = {1 - x - y}}}$

For a six-primary color system using an ITU-R BT.709-6 (6P-B) colorgamut, the white point is D65:

$0.9504 = {{\frac{{0.3}127}{{0.3}290}\mspace{20mu} 0.3584} = {1 - {{0.3}127} - {{0.3}290}}}$

For a six-primary color system using an SMPTE RP431-2 (6P-C) colorgamut, the white point is D60:

$0.9541 = {{\frac{{0.3}218}{{0.3}372}\mspace{20mu} 0.3410} = {1 - {{0.3}218} - {{0.3}372}}}$

Following the white point conversion, a calculation is required for RGBsaturation values, S_(R), S_(G), and S_(B). The results from the secondoperation are inverted and multiplied with the white point XYZ values.In one embodiment, the color gamut used is an ITU-R BT.709-6 colorgamut. The values calculate as:

$\begin{bmatrix}S_{R} \\S_{G} \\S_{B}\end{bmatrix}^{{ITU} - {{RB}{T.7}09} - 6} = \lbrack {\begin{pmatrix}{{5.4}45} & {{- {4.6}}44} & {{- {0.0}}253} \\{{- {4.6}}44} & {{6.3}37} & {{- {0.5}}63} \\{{- {0.0}}253} & {{- {0.5}}63} & {{1.6}82}\end{pmatrix}\begin{pmatrix}{{0.9}50} \\1 \\{{0.3}58}\end{pmatrix}} \rbrack$ ${{Where}\begin{bmatrix}S_{R} \\S_{G} \\S_{B}\end{bmatrix}}^{{ITU} - {{RBT}{.709}} - 6} = \begin{bmatrix}{{0.5}22} \\{{1.7}22} \\{{0.0}15}\end{bmatrix}$

In one embodiment, the color gamut is an SMPTE RP431-2 color gamut. Thevalues calculate as:

$\begin{bmatrix}S_{R} \\S_{G} \\S_{B}\end{bmatrix}^{{{SMPTE}\;{RP}\; 431} - 2} = \lbrack {\begin{pmatrix}{{3.6}92} & {{- {2.6}}49} & {{- {0.2}}11} \\{{- {2.6}}49} & {{3.7}95} & {{- {0.1}}89} \\{{- {0.2}}11} & {{- {0.1}}89} & {{1.6}11}\end{pmatrix}\begin{pmatrix}{{0.9}54} \\1 \\{{0.3}41}\end{pmatrix}} \rbrack$ ${{Where}\begin{bmatrix}S_{R} \\S_{G} \\S_{B}\end{bmatrix}}^{{{SMPTE}\;{RP}\; 431} - 2} = \begin{bmatrix}{{0.8}02} \\{{1.2}03} \\{{0.1}59}\end{bmatrix}$

Next, a six-primary color-to-XYZ matrix must be calculated. For anembodiment where the color gamut is an ITU-R BT.709-6 color gamut, thecalculation is as follows:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = {{\quad\quad}\lbrack \ {\begin{pmatrix}{{0.5}19} & {{0.3}93} & {{0.1}40} \\{{0.3}93} & {{0.4}60} & {{0.1}60} \\{{0.1}40} & {{0.1}60} & {{0.6}50}\end{pmatrix}^{{ITU} - {{RBT}{.709}} - 6}\ \begin{pmatrix}{{0.5}22} & {{1.7}22} & {{0.1}53} \\{{0.5}22} & {{1.7}22} & {{0.1}53} \\{{0.5}22} & {{1.7}22} & {{0.1}53}\end{pmatrix}^{D\; 6\; 5}} \rbrack}$Wherein the resulting matrix is multiplied by the S_(R)S_(G)S_(B)matrix:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = {\begin{bmatrix}{{0.2}71} & {{0.6}77} & {{0.0}02} \\{{0.2}05} & {{0.7}92} & {{0.0}03} \\{{0.0}73} & {{0.2}76} & {{0.0}10}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\Y \\M\end{bmatrix}}^{{ITU} - {{RB}{T.7}09} - 6}$For an embodiment where the color gamut is an SMPTE RP431-2 color gamut,the calculation is as follows:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = \lbrack \ {\begin{pmatrix}{{0.5}65} & {{0.4}01} & {{0.1}21} \\{{0.4}01} & {{0.5}49} & {{0.1}17} \\{{0.1}21} & {{0.1}17} & {{0.6}50}\end{pmatrix}^{{{SMPTERP}431} - 2}\ \begin{pmatrix}{{0.8}02} & {{1.2}03} & {{0.1}59} \\{{0.8}02} & {{1.2}03} & {{0.1}59} \\{{0.8}02} & {{1.2}03} & {{0.1}59}\end{pmatrix}^{D\; 60}} \rbrack$Wherein the resulting matrix is multiplied by the S_(R)S_(G)S_(B)matrix:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = {\begin{bmatrix}{{0.4}53} & {{0.4}82} & {{0.0}19} \\{{0.3}21} & {{0.6}60} & {{0.0}19} \\{{0.0}97} & {{0.1}41} & {{0.1}03}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\Y \\M\end{bmatrix}}^{{{SMPTERP}\; 431} - 2}$

Finally, the XYZ matrix must converted to the correct standard colorspace. In an embodiment where the color gamut used is an ITU-R BT709.6color gamut, the matrices are as follows:

$\begin{bmatrix}R \\G \\B\end{bmatrix}^{{ITU} - {{RB}T709.6}} = {\begin{bmatrix}{{3.2}41} & {{- {1.5}}37} & {{- {0.4}}99} \\{{- {0.9}}69} & {{1.8}76} & {{0.0}42} \\{{0.0}56} & {{- {0.2}}04} & {{1.0}57}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}$In an embodiment where the color gamut used is an SMPTE RP431-2 colorgamut, the matrices are as follows:

$\begin{bmatrix}R \\G \\B\end{bmatrix}^{{{SMPTERP}\; 431} - 2} = {\begin{bmatrix}{{2.7}3} & {{- {1.0}}18} & {{- {0.4}}40} \\{{- {0.7}}95} & {{1.6}90} & {{0.0}23} \\{{0.0}41} & {{- {0.0}}88} & {{1.1}01}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}$

Packing a Six-Primary Color System into IC_(T)C_(P)

IC_(T)C_(P) (ITP) is a color representation format specified in the Rec.ITU-R BT.2100 standard that is used as a part of the color imagepipeline in video and digital photography systems for high dynamic range(HDR) and wide color gamut (WCG) imagery. The I (intensity) component isa luma component that represents the brightness of the video. C_(T) andC_(P) are blue-yellow (“tritanopia”) and red-green (“protanopia”) chromacomponents. The format is derived from an associated RGB color space bya coordination transformation that includes two matrix transformationsand an intermediate non-linear transfer function, known as a gammapre-correction. The transformation produces three signals: I, C_(T), andC_(P). The ITP transformation can be used with RGB signals derived fromeither the perceptual quantizer (PQ) or hybrid log-gamma (HLG)nonlinearity functions. The PQ curve is described in ITU-RBT2100-2:2018, Table 4, which is incorporated herein by reference in itsentirety.

FIG. 53 illustrates one embodiment of packing six-primary color systemimage data into an IC_(T)C_(P) (ITP) format. In one embodiment, RGBimage data is converted to an XYZ matrix. The XYZ matrix is thenconverted to an LMS matrix. The LMS matrix is then sent to an opticalelectronic transfer function (OETF). The conversion process isrepresented below:

$\begin{bmatrix}L \\M \\S\end{bmatrix} = {\lbrack {\begin{pmatrix}a_{11} & a_{12} & a_{13} \\a_{21} & a_{22} & a_{23} \\a_{31} & a_{32} & a_{33}\end{pmatrix}\begin{pmatrix}{{0.3}59} & {{0.6}96} & {{- {0.0}}36} \\{{- {0.1}}92} & {{1.1}00} & {{0.0}75} \\{{0.0}07} & {{0.0}75} & {{0.8}43}\end{pmatrix}} \rbrack\begin{bmatrix}R \\G \\B\end{bmatrix}}$Output from the OETF is converted to ITP format. The resulting matrixis:

$\quad\begin{pmatrix}0.5 & 0.5 & 0 \\1.614 & {- 3.323} & 1.710 \\4.378 & {- 4.246} & {- 0.135}\end{pmatrix}$

FIG. 54 illustrates one embodiment of a six-primary color systemconverting RGBCYM image data into XYZ image data for an ITP format(e.g., 6P-B, 6P-C). For a six-primary color system, this is modified byreplacing the RGB to XYZ matrix with a process to convert RGBCYM to XYZ.This is the same method as described in the legacy RGB process. The newmatrix is as follows for an ITU-R BT.709-6 (6P-B) color gamut:

$\begin{bmatrix}L \\M \\S\end{bmatrix} = {\begin{pmatrix}{{0.2}71} & {{0.6}77} & {{0.0}02} \\{{0.2}05} & {{0.7}92} & {{0.0}03} \\{{0.0}73} & {{0.2}77} & {{0.1}00}\end{pmatrix}{\begin{pmatrix}{{0.3}59} & {{0.6}96} & {{- {0.0}}36} \\{{- {0.1}}92} & {{1.1}00} & {{0.0}75} \\{{0.0}07} & {{0.0}75} & {{0.8}43}\end{pmatrix}\begin{bmatrix}R \\G \\B \\C \\Y \\M\end{bmatrix}}^{{ITU} - {{RBT}{.709}} - 6}}$

RGBCYM data, based on an ITU-R BT.709-6 color gamut, is converted to anXYZ matrix. The resulting XYZ matrix is converted to an LMS matrix,which is sent to an OETF. Once processed by the OETF, the LMS matrix isconverted to an ITP matrix. The resulting ITP matrix is as follows:

$\quad\begin{pmatrix}0.5 & 0.5 & 0 \\1.614 & {- 3.323} & 1.710 \\4.378 & {- 4.246} & {- 0.135}\end{pmatrix}$

In another embodiment, the LMS matrix is sent to an Optical OpticalTransfer Function (OOTF). In yet another embodiment, the LMS matrix issent to a Transfer Function other than OOTF or OETF.

In another embodiment, the RGBCYM data is based on the SMPTE ST431-2(6P-C) color gamut. The matrices for an embodiment using the SMPTEST431-2 color gamut are as follows:

$\begin{bmatrix}L \\M \\S\end{bmatrix} = {\begin{pmatrix}{{0.4}53} & {{0.4}81} & {{0.0}19} \\{{0.3}21} & {{0.6}60} & {{0.0}19} \\{{0.0}97} & {{0.1}41} & {{0.1}03}\end{pmatrix}{\begin{pmatrix}{{0.3}59} & {{0.6}96} & {{- {0.0}}36} \\{{- {0.1}}92} & {{1.1}00} & {{0.0}75} \\{{0.0}07} & {{0.0}75} & {{0.8}43}\end{pmatrix}\begin{bmatrix}R \\G \\B \\C \\Y \\M\end{bmatrix}}^{{{SMPTEST}\; 431} - 2}}$The resulting ITP matrix is:

$\quad\begin{pmatrix}0.5 & 0.5 & 0 \\1.614 & {- 3.323} & 1.710 \\4.378 & {- 4.246} & {- 0.135}\end{pmatrix}$

The decode process uses the standard ITP decode process, as theS_(R)S_(G)S_(B) cannot be easily inverted. This makes it difficult torecover the six RGBCYM components from the ITP encode. Therefore, thedisplay is operable to use the standard ICtCp decode process asdescribed in the standards and is limited to just RGB output.

Converting from XYZ to 6P Using Multiple Primary Triads

Another approach to converting an XYZ matrix, constructed using XYZcolor data, to RGBCYM color data makes use of multiple primary triads.In one embodiment, primary triads are created using common edges withinthe color gamut. Primary triads include, but are not limited to, an RGBtriad, a GCB triad, an RYG triad, and/or an RBM triad. In anotherembodiment, the primary triad includes a CYM triad. By making use ofprimary triads, the system ensures that all areas of a color gamut arecovered. The expected result is that at a boundary line for an alternatetriad, results from RGB and the alternate triad are identical. However,this is not the case. While the results are not equal, valuescorresponding to the RGB triad and the alternate triad are in aspecified ratio.

FIG. 100 illustrates one embodiment of a multi-primary triad color gamutusing CIE-1931 color space.

This result is in part due to a non-equality between the main RGB triadand an adjacent triad, which indicates that the primary definitions werenot using the same white point. By not using the same white point, animbalance exists between the main RGB triad and the adjacent triad. Toaccount for this imbalance, the six-primary color system data must beconverted from device-independent coordinates. In one embodiment, theorder of the primary triads is not important.

The conversion to the six-primary color system data fromthree-dimensional (3D) color space involves a degree of freedom, due inpart to issues with metamerisms. In one embodiment, in order to convertbetween these formats efficiently, a number of matrices are created.These matrices perform “switch” operations, whereby matricescorresponding to six-primary color system data are swapped depending onthe input chromaticity. In another embodiment, this process is performedusing two-dimensional (2D) look-up tables. See, e.g., Takeshi Obi etal., Color Conversion Method for Multiprimary Display Using MatrixSwitching, Optical Review Vol. 8, No. 3, May, 2001, at 191-197, which isincorporated herein by reference in its entirety.

In one embodiment, the matrices reflect REC 709 chromaticity coordinatesin CIE 1931 color space. Table 16 illustrates RGB coordinates using aD65 white point in CIE 1931 color space.

TABLE 16 Primary X-coordinate Y-coordinate R 0.64 0.33 G 0.3 0.6 B 0.150.06 Wh (D65) 0.3127 0.329

In one embodiment, the matrices reflect REC 709 chromaticity coordinatesin CIE 1976 color space. Table 17 illustrates RGB coordinates using aD65 white point in CIE 1976 color space.

TABLE 17 Primary u-coordinate v-coordinate X-coordinate Y-coordinate R0.4507 0.5229 0.64000 0.3300 G 0.125 0.5625 0.3000 0.6000 B 0.17540.1579 0.15000 0.06000

In CIE-XYZ color space, a 3D color gamut, referred to as a color solid,by an additive mixture of multi-primaries becomes a polyhedron, wherethe color solid with the three base primaries, RGB, is represented by ahexahedron. When the spectral intensities of N primary lights areS_(j)(λ)[j=1, . . . , N], the total spectral intensity of thereconstructed light is given by:

${C(\lambda)} = {{\sum\limits_{j = 1}^{N}{\alpha_{j}{S_{j}(\lambda)}}} + {\beta(\lambda)}}$where α_(j)(0≤α_(j)≤1) is the weight of the j-th primary colorcontributed by a modulating signal, and β(λ) is the spectral intensityof background light. In one embodiment, it is assumed S_(j)(λ) is thespectral intensity of each primary light full-emitted by a displaydevice.

Using CIE-XYZ color matching functions x(λ), y(λ), and z(λ), the otherCIE-XYZ color coordinates c=(c_(X), c_(Y), c_(Z))^(t) are reconstructedusing an additive mixture of N primaries expressed as:

$c = {\begin{pmatrix}C_{x} \\C_{y} \\C_{z}\end{pmatrix} = {{\sum\limits_{j = 1}^{N}{\alpha_{j}\begin{pmatrix}{\int{\{ {{S_{j}(\lambda)} + {\beta(\lambda)}} \}{\overset{¯}{x}(\lambda)}{d\lambda}}} \\{\int{\{ {{S_{j}(\lambda)} + {\beta(\lambda)}} \}{\overset{¯}{y}(\lambda)}{d\lambda}}} \\{\int{\{ {{S_{j}(\lambda)} + {\beta(\lambda)}} \}{\overset{¯}{z}(\lambda)}{d\lambda}}}\end{pmatrix}}} = {{\sum\limits_{j = 1}^{N}{\alpha_{j}P_{j}}} + {b\mspace{20mu}( {0 \leq \alpha_{j} \leq 1} )}}}}$where b=(b_(X), b_(Y), b_(Z))^(t) are the color coordinates of thebackground light and P_(j)=(P_(X) ^(j), P_(Y) ^(j), P_(Z) ^(j))^(t) isthe color vector of the j-th primary color disregarding the backgroundlight.

The region c represented by the above equation corresponds to the gamutin CIE-XYZ color space. Applying the adequate weight, α_(j), to eachprimary color, the arbitrary color inside the primary color solid isreproduced. In one embodiment, the above equation assumes that eachprimary light has a constant chromaticity and is added to otherprimaries independently.

Table 18 illustrates chromaticity matrix values for a 6P-B system.

TABLE 18 Primary u-coordinate v-coordinate X-coordinate Y-coordinateSaturation R 0.4507 0.5229 0.64002 0.33002 3.4558 G 0.125 0.5625 0.300000.60000 2.0664 B 0.1754 0.1579 0.14997 0.06000 6.0598 C 0.1 0.4460.16471 0.32650 1.3437 Y 0.204 0.565 0.43881 0.54015 1.8874 M 0.33 0.2930.31963 0.12613 3.8261 Wh (D65) 0.1978 0.4683 0.3127 0.3290 N/A

Table 19 illustrates chromaticity matrix values for a 6P-C system. Notethat the 6P-C system uses a white point of D60.

TABLE 19 Primary u v X Y Z R 0.4964 0.5256 0.68012 0.32006 −0.00018 G0.098 0.5777 0.26369 0.69086 0.04544 B 0.1754 0.1579 0.14997 0.060000.79002 C 0.96 0.454 0.16265 0.34187 0.49548 Y 0.2078 0.5683 0.450220.54723 0.00255 M 0.352 0.32 0.35321 0.14235 0.50534 Wh (D60) 0.2010.474 0.32177 0.33725 0.34098

Next, the signal from each primary color must be computed from thetristimulus values of CIE-XYZ. The signal for a multi-primary display istreated as α_(j)[j=1, . . . , N]. In addition, the modulating signalapplied to a display device is compensated from α_(j) depending onindividual device characteristics. Device characteristics include, butare not limited to, gamma characteristics, luminance, luminance unity,visual acuity, flicker threshold, contrast, contrast polarity,resolution, refresh rate, temporal instability, persistence, color,and/or reflect characteristics. This conversion process is performed byinverting the following equation:

$\begin{matrix}{{{\sum\limits_{j = 1}^{N}{\alpha_{j}P_{j}}} + b}\ } & ( {0 \leq \alpha_{j} \leq 1} )\end{matrix}$ as   α = (α_(1, . . . , )N)^(t) = P⁻(c − b)where P⁻ is a generalized inverse of the P=[P₁, . . . , N] and P is a3×N matrix. Thus, the inversion includes a degree of freedom. In oneembodiment, the dynamic range corresponding to a display device is underthe constraint of 0≤α_(j)≤1. Therefore, the inverse equation requiresonly a partial nonlinear calculation. When color signals are convertedto matrices, some values return as negative. These negative values areset to zero and then all matrices are combined.

Still, this conversion requires matrices for linear transforms, wherethe number of matrices is equal to the number of elements present. Here,the matrices are switched depending on the element where a specifiedcolor is included. In one embodiment, the matrix switching is performedusing 2D look-up tables, reducing the system's overall computationalrequirements.

In one embodiment, a color solid is divided into a specified number ofquadrangle pyramids. In another embodiment, a color solid for amulti-primary display is represented by a convex polyhedron fenced byparallelogram planes, where each parallelogram is covered by N-primarycolor vectors, starting from the coordinates of the sum of the otherprimary color vectors. As each parallelogram plane is constructed with acombination of two primary color vectors, the number of surface planesis equal to twice the number of combinations of primary vectors. This isexpressed as:2_(N) C _(N) =N(N−1)

Next, the color solid is divided into quadrangle pyramids, where thequadrangle pyramid basses are present at each surface plane except thosepyramids with a vertex value at b, where b is a background light foreach vertex of the color solid. As there are N surface planes containingb as a coordinate point, the total number of quadrangle pyramids isequal toN(N−1)−N=N(N−2)where the summit of each of the quadrangle pyramids is represented bythe coordinates of b. The coordinates for the vertices at the base ofeach quadrangle pyramid are represented asq _(i)[i=1, . . . ,4]and the color coordinates, c, inside each of the quadrangle pyramids areexpressed asc=ν[(q ₁ −b)+β(q ₂ −q ₁)+γ(q ₃ −q ₁)]+bwhere 0≤ν≤1, 0≤β≤1, and 0≤γ≤1. Vertices q₂ and q₃ are adjacent to q₁.

During the matrix switching process, additivity applies regardless ofthe number of primaries present. The complication this introduces isthat by having more than three primaries, there are a variety ofmulti-primary signals corresponding to each visible color. Thus, thesystem needs to determine a single set of primary signals for eachvisible color. In one embodiment, the signals are chosen based on alower inter-observer color variation. This results in smoother signals,as the system uses as many of the primary colors as possible in order toproduce the right color and/or primary signal. In one embodiment, thesignals are chosen based on how smooth the colors transition from oneprimary to the next. In another embodiment, the signals are chosen basedon the ability of the system to minimize contouring. This avoids issueswith contour jumping between adjacent primary colors and/or signals. Inanother embodiment, the signals are chosen based on mapping out-of-gamutcolors to in-gamut colors. In yet another embodiment, the signals arechosen using multidimensional look-up tables, avoiding issues associatedwith interpolation. In yet another embodiment, the signals are chosenbased on any combination of the aforementioned techniques. Signalcapture methods and techniques are referred to as multi-spectralcapture.

In a preferred embodiment, multi-channel signals from color imagery arecreated using an algorithm. The algorithm takes advantage of any of thepreviously mentioned signal-choosing techniques. In one embodiment, thealgorithm is a blending algorithm. Blending refers to the process oflayering multiple images into one image. Blending processes include, butare not limited to, division, addition, subtraction, differenceblending, Boolean arithmetic blending processes, hue processes,luminosity processes, and/or saturation processes. Division blendprocesses divide pixel values of one layer with another layer, primarilyuseful when images require brightening. Addition blend processes add thepixel values of one layer to another layer, producing an image withpixel color values equal to that of the original layers. Subtractionblend processes subtract the pixel values of one layer from anotherlayer. Difference blend processes subtracts pixel values of a bottom layfrom the pixel values of a top layer, where the resulting image(s)display with a smooth transition. Boolean arithmetic blend processescombine the binary expansion of the hexadecimal color at each pixel oftwo layers using Boolean logic gates, where the top layer's alphacontrols interpolation between the lower layer's image and a resultingcombined image. Hue blending processes preserve the luma and chroma of abottom layer, while simultaneously adopting the hue of a top layer.Saturation blend processes preserve the luma and hue of a bottom layer,while simultaneously adopting the chroma of a top layer. Luminosityblend processes preserve the hue and chroma of a bottom layer, whilesimultaneously adopting the luma of a top layer.

In one embodiment, the system is operable to blend multiple six-primaryimages for display using a gradient blending algorithm. In oneembodiment, the system is operable to blend multiple six-primary imagesfor display using a multi-frame exposure fusion algorithm, such as theone described in Anmol Biswas et al., Spatially Variant LaplacianPyramids for Multi-Frame Exposure Fusion, February 2020, which is herebyincorporated by reference in its entirety.

The matrix switching process results in updated matrices correspondingto each of the 6P systems. Table 20 illustrates the results of matrixswitching for a 6P-B system and Table 21 illustrates the results ofmatrix switching for a 6P-C system.

TABLE 20 Primary x y u′ v′ R 0.6400 0.3300 0.4507 0.5228 Y 0.4400 0.53950.2047 0.5649 G 0.3000 0.6000 0.1250 0.5625 C 0.1655 0.3270 0.10410.4463 B 0.1500 0.0600 0.1754 0.1578 M 0.3221 0.1266 0.3325 0.2940

TABLE 21 Primary x y u′ v′ R 0.6800 0.3200 0.4964 0.5256 Y 0.4502 0.54720.2078 0.5683 G 0.2650 0.6900 0.0980 0.5777 C 0.1627 0.3419 0.09600.4540 B 0.1500 0.0600 0.1754 0.1579 M 0.3523 0.1423 0.3520 0.3200

Converting ACES to 6P and then Converting Back to ACES

The Academy Color Encoding System (ACES) was designed by the Academy ofMotion Picture Arts and Sciences to be an industry standard for color.ACES covers the entire process of filmmaking, including, but not limitedto, image capture, editing, visual effects (VFX), presentation,archiving, and future remastering. More specifically, ACES is a seriesof guidelines and specifications for every type of color management.ACES guidelines include, but are not limited to, encodingspecifications, transform definitions and guidelines, metadatadefinitions, standard screen specifications, and/or specifications forarchive-ready image data and metadata. Furthermore, the ACES color spaceincludes everything visible to the human eye. This means that the ACEScolor space is free of restrictions and/or limitations. The ACES processis standardized under SMPTE ST 2065-1 (2012), SMPTE ST 2065-2 (2012),SMPTE ST 2065-3 (2012), SMPTE ST 2065-4 (2013), and SMPTE ST 2065-5(2016), each of which is incorporated herein by reference in itsentirety.

In order to convert from an ACES system to 6P, and then from 6P back toACES, the system uses a pseudo-inverse matrix. In one embodiment, thepseudo-inverse matrix is an asymmetric matrix. However, usingtraditional color space matrices in the process results in the systemoutputting a negative value. This negative value translates into a“negative” color, which does not exist. As such, a negative valueindicates that the incorrect primaries were being used for a specifiedcolor. Therefore, the system performs these matrix operations usingtriads, as described in the conversion from XYZ color space to 6P colorspace.

Each triad incorporates a set of three of the existing six primarycolors. Each of these triads represents a subdivision of color spaceinto different regions. In one embodiment, the system includes a primarytriad. In one embodiment, the primary triad is RGM (Red, Green,Magenta). In another embodiment, the primary triad is CYM (Cyan, Yellow,Magenta). In another embodiment, the system includes a primary triad, asecondary triad, a tertiary triad, and a quaternary triad, wherein theprimary triad is RGM, the secondary triad is GCB (Green, Cyan, Blue),the tertiary triad is RYB (Red, Yellow, Blue), and the quaternary triadis RBM (Red, Blue, Magenta). In yet another embodiment, there is noprimary triad. In yet another embodiment, there are more than fourtriads.

FIG. 101 illustrates a table of Blue to Red line edge values between RGBand RMB triads.

Similar to the XYZ-to-6P conversion, the conversion from ACES to 6P, andthen from 6P to ACES uses calculations based on XYZ values for each ofthe primaries. In one embodiment, this conversion process is only validwith in-gamut colors. For out-of-gamut colors, the 6P system convertsthese colors to in-gamut colors based on what the specific out-of-gamutcolor is. This conversion process does not require the pre-selection ofmatrices, as all matrices are converted and results are combined. Inaddition, ACES-to-6P-to-ACES conversion process does not require matrixswitching, unlike the XYZ-to-6P conversion process.

FIG. 102 illustrates a YWV plot of a 6P system and an ACES 0 system.

FIG. 103 illustrates a table corresponding to chromaticity matrix valuesfor a 6P system. The chromaticity matrix values reflect valuescorresponding to primaries in a 6P-B system. In order to initiate theconversion process, the following matrix is used to convert to YWV colorspace, where YWV represents a luminance-linear color space:

$\quad\begin{pmatrix}0 & 1 & 0 \\{- 0.54} & {- 0.187} & 0.643 \\1.823 & {- 1.478} & {- 0.234}\end{pmatrix}$

In addition, the ACES-to-6P-to-ACES conversion process is operable touse the chromaticity values present in Table 18 for a 6P-B system andthe chromaticity values present in Table 19 for a 6P-C system.

FIG. 104 illustrates a gamut using 6P-B chromaticity values for anACES-to-6P-to-ACES conversion process.

In one embodiment, the ACES-to-6P-to-ACES conversion process firstconverts an RGB value in ACES D60 to XYZ. To convert the RGB value inACES D60 to XYZ for a 6P-B system, the following equation is used:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix}_{D\; 65} = {\begin{bmatrix}{{0.9}3865266} & {{- {0.0}}0574000} & {{0.0}1751701} \\{{0.3}3810177} & {{0.7}2722662} & {{- {0.0}}6532839} \\{{0.0}0072102} & {{0.0}0081573} & {{1.0}8726381}\end{bmatrix}\begin{bmatrix}R \\G \\B\end{bmatrix}}_{{ACES}_{{AP}\; 0}}$

Conversion values for each color value (RGBCMY) to XYZ are listed inTable 22 below.

TABLE 22 RXYZ 0.4124 0.2126 0.0193001 GXYZ 0.3576 0.7152 0.1192 BXYZ0.1805 0.0721998 0.9505 CXYZ 0.15749 0.313266 0.48142 MXYZ 0.342760.13472 0.586662 YXYZ 0.450206 0.552013 0.0209755

The ACES-to-6P-to-ACES conversion process further includes a set ofmatrices enabling the conversion from RGB to 6P, where the set ofmatrices includes, but is not limited to, an XYZ-to-RGB matrix, anXYZ-to-CMY matrix, an XYZ-to-RMB matrix, an XYZ-to-BCG matrix, and/or anXYZ-to-GYR matrix. These matrices represent the matrix conversions foreach primary triad used in the conversion from RGB to 6P. To create thematrices from D65 XYZ to the different primary triads, an inverse of thetranspose of the three 6P-B primaries are taken. In one embodiment, anXYZ-to-RGB matrix is created using the inverse of the result fromtransposing an RXYZ matrix, an GXYZ matrix, and a BXY matrix. Forexample, to obtain the RGB triad, an inverse is taken of the transposeof a matrix created using the first three rows of Table 22. Theconversion from D65 XYZ color space to RGB in a 6P-B system using thisprocess is shown below in the following equation:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{{6P} - B} = {\begin{bmatrix}{{3.2}40625} & {{- {1.5}}37208} & {{- {0.4}}98629} \\{{- {0.9}}68931} & {{1.8}75756} & {{0.0}41518} \\{{0.0}55710} & {{- {0.2}}04021} & {{1.0}56996}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

In one embodiment, an XYZ-to-CMY matrix is created using the inverse ofthe result from transposing a CXYZ matrix, a MXYZ matrix, and a YXYZmatrix. The conversion from D65 XYZ color space to CMY in a 6P-B systemis shown below in the following equation:

$\begin{bmatrix}C \\M \\Y\end{bmatrix}_{{6P} - B} = {\begin{bmatrix}{{- {3.4}}96203} & {{2.7}98197} & {{1.4}00100} \\{{2.8}22710} & {{- {2.3}}24505} & {{0.5}89173} \\{{1.2}95195} & {{0.7}90883} & {{- {0.9}}38342}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

In one embodiment, an XYZ-to-RMB matrix is created using the inverse ofthe result from transposing a RXYZ matrix, a MXYZ matrix, and a BXYZmatrix. The conversion from D65 XYZ color space to RMB in a 6P-B systemis shown below in the following equation:

$\begin{bmatrix}R \\M \\B\end{bmatrix}_{{6P} - B} = {\begin{bmatrix}{{- {7.5}}1569} & {1{9.2}86} & {{- {0.0}}377284} \\{1{7.6}005} & {{- 3}{4.0}728} & {{- {0.7}}54168} \\{{- 1}{0.7}107} & {2{0.6}386} & {{1.5}1833}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

In one embodiment, an XYZ-to-BCG matrix is created using the inverse ofthe result from transposing a BXYZ matrix, a CXYZ matrix, and a GXYZmatrix. The conversion from D65 XYZ color space to BCG in a 6P-B systemis shown below in the following equation:

$\begin{bmatrix}B \\C \\G\end{bmatrix}_{{6P} - B} = {\{ \begin{matrix}{{7.0}1624} & {{- {3.5}}0579} & {{- {0.0}}140081} \\{{- 1}{5.3}41} & {{7.2}7709} & {{2.3}6049} \\{{6.0}1125} & {{- {1.4}}3533} & {{- {1.0}}3251}\end{matrix} \rbrack\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

In one embodiment, an XYZ-to-GYR matrix is created using the inverse ofthe result from transposing a GXYZ matrix, a YXYZ matrix, and a RXYZmatrix. The conversion from D65 XYZ color space to GYR in a 6P-B systemis shown below in the following equation:

$\begin{bmatrix}G \\Y \\R\end{bmatrix}_{{6P} - B} = {\begin{bmatrix}{{- {0.4}}57517} & {{0.0}0285821} & {{9.7}4466} \\{{- {0.8}}52221} & {{3.1}21} & {{- 1}{6.1}693} \\{{3.7}519} & {{- {3.4}}0959} & {{9.2}0183}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

The XYZ value is multiplied by each of the XYZ-to-triad matrices shownabove (i.e., the XYZ-to-RGB matrix, the XYZ-to-CMY matrix, theXYZ-to-RMB matrix, the XYZ-to-BCG matrix, the XYZ-to-GYR matrix). Theresult of each multiplication is filtered for negative values. If aresulting matrix includes one or more negative values, all three valuesin the resulting matrix are set to zero. This results in a set of triadvalue 3-vectors, wherein the set of triad value 3-vectors is convertedinto RGBCYM 6-vectors by placing values at their respective componentpositions in the RGBCYM 6-vectors and placing zero values at the threeunused component positions. If any of the merged colors are present intwo triads (e.g., RGB and RMB), the values are divided by two (2) andmerged back into the matrices, resulting in a set of final 6P values. Ifthe merged colors do not have two triads, this represents the set offinal 6P values.

The set of final 6P values is converted back to D65 XYZ space using a6P-to-XYZ matrix. The conversion from 6P-to-XYZ for 6P-B is shown belowin the following equation:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix}_{D\; 65} = {\begin{bmatrix}0.4124 & 0.3576 & 0.1805 & 0.15749 & 0.34276 & 0.450206 \\0.2126 & 0.7152 & 0.0721998 & 0.313266 & 0.13472 & 0.552013 \\0.0193001 & 0.1192 & 0.9505 & 0.48142 & 0.586662 & 0.0209755\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - B}$

Once this conversion is complete, the XYZ values are converted to ACESAP-0 using an XYZ-to-ACES matrix. This matrix is the inverse of theACES-to-XYZ matrix. The conversion from XYZ-to-ACES is shown below inthe following equation:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{{ACES}_{{AP}\; 0}} = {\begin{bmatrix}{{1.0}6234} & {{0.0}0840371} & {{- {0.0}}166106} \\{{- {0.4}}93934} & {{1.3}7109} & {{0.0}903398} \\{{- {0.0}}00333913} & {{- {0.0}}0103425} & {{0.9}19683}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 65}$

A similar process is used to convert from ACES to 6P-C and back to ACES.To convert the RGB value in ACES D60 to XYZ for a 6P-C system using anACES white point, the following equation is used:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix}_{D\; 60_{ACES}} = {\begin{bmatrix}{{0.9}525523959} & 0 & {{0.0}000936786} \\{{0.3}439664498} & {{0.7}281660966} & {{- {0.0}}721325464} \\0 & 0 & {{1.0}088251844}\end{bmatrix}\begin{bmatrix}R \\G \\B\end{bmatrix}}_{D\; 60_{ACES}}$

Conversion values for each color value (RGBCMY) to XYZ are listed inTable 23 below.

TABLE 23 RXYZ 0.50836664 0.23923145 −0.0001363 GXYZ 0.262370690.68739938 0.04521596 BXYZ 0.1833767 0.07336917 0.96599714 CXYZ0.15745217 0.33094114 0.47964602 MXYZ 0.36881328 0.14901541 0.52900498YXYZ 0.42784843 0.52004327 0.00242485

In one embodiment, an XYZ-to-RGB matrix is created using the inverse ofthe result from transposing an RXYZ matrix, an GXYZ matrix, and a BXYmatrix. For example, to obtain the RGB triad, an inverse is taken of thetranspose of a matrix created using the first three rows of Table 23 for6P-C. The conversion from D65 XYZ color space to RGB in a 6P-C systemusing an ACES white point is shown below in the following equation:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{{6P} - C} = {\begin{bmatrix}{{2.3}83102} & {{- {0.8}}84257} & {{- {0.3}}85227} \\{{- {0.8}}33577} & {{1.7}71364} & {{0.0}23701} \\{{0.0}39354} & {{- {0.0}}83038} & {{1.0}34036}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

In one embodiment, an XYZ-to-CMY matrix is created using the inverse ofthe result from transposing a CXYZ matrix, a MXYZ matrix, and a YXYZmatrix. The conversion from D65 XYZ color space to CMY in a 6P-C systemusing an ACES white point is shown below in the following equation:

$\begin{bmatrix}C \\M \\Y\end{bmatrix}_{{6P} - C} = {\begin{bmatrix}{{- {2.9}}61772} & {{2.4}30264} & {{1.3}80316} \\{{2.6}80304} & {{- {2.2}}08133} & {{0.6}43688} \\{{1.1}16764} & {{1.0}09092} & {{- {1.0}}62840}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

In one embodiment, an XYZ-to-RMB matrix is created using the inverse ofthe result from transposing a RXYZ matrix, a MXYZ matrix, and a BXYZmatrix. The conversion from D65 XYZ color space to RMB in a 6P-C systemusing an ACES white point is shown below in the following equation:

$\begin{bmatrix}R \\M \\B\end{bmatrix}_{{6P} - C} = {\begin{bmatrix}{{- 1}{2.2}58108} & {3{0.2}28550} & {{0.0}31061} \\{2{6.9}45451} & {{- 5}{7.2}59520} & {{- {0.7}}66129} \\{{- 1}{4.7}577636} & {3{1.3}61077} & {{1.4}54757}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

In one embodiment, an XYZ-to-BCG matrix is created using the inverse ofthe result from transposing a BXYZ matrix, a CXYZ matrix, and a GXYZmatrix. The conversion from D65 XYZ color space to BCG in a 6P-C systemusing an ACES white point is shown below in the following equation:

$\begin{bmatrix}B \\C \\G\end{bmatrix}_{{6P} - C} = {\begin{bmatrix}{1{1.1}09755} & {{- {4.1}}90743} & {{- {0.7}}55486} \\{{- 2}{3.3}21462} & {{8.6}53499} & {{3.7}69897} \\{1{0.0}42078} & {{- {2.2}}64081} & {{- {1.7}}34341}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

In one embodiment, an XYZ-to-GYR matrix is created using the inverse ofthe result from transposing a GXYZ matrix, a YXYZ matrix, and a RXYZmatrix. The conversion from D65 XYZ color space to GYR in a 6P-C systemusing an ACES white point is shown below in the following equation:

$\begin{bmatrix}G \\Y \\R\end{bmatrix}_{{6P} - C} = {\begin{bmatrix}{{0.0}98523} & {{- {0.1}}95369} & {2{4.5}14579} \\{{- {1.6}}50905} & {{3.4}83415} & {{- 4}{3.3}77476} \\{{3.3}05661} & {{- {2.8}}30859} & {2{3.8}54979}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

The XYZ value is multiplied by each of the XYZ-to-triad matrices shownabove (i.e., the XYZ-to-RGB matrix, the XYZ-to-CMY matrix, theXYZ-to-RMB matrix, the XYZ-to-BCG matrix, the XYZ-to-GYR matrix). Theresult of each multiplication is filtered for negative values. If aresulting matrix includes one or more negative values, all three valuesin the resulting matrix are set to zero. This results in a set of triadvectors. If any of the merged colors are present in two triads (e.g.,RGB and RMB), the values are divided by two (2) and merged back into thematrices, resulting in a set of final 6P values. If the merged colors donot have two triads, this represents the set of final 6P values.

The set of final 6P values is converted back to XYZ space with an ACESwhite point using a 6P-to-XYZ matrix. The conversion from 6P-to-XYZ for6P-C is shown below in the following equation:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix}_{D\; 6\; 0_{ACES}} = {\begin{bmatrix}{{0.5}0836664} & {{0.2}6237069} & {{0.1}833767} & {{0.1}5745217} & {{0.3}6881328} & {{0.4}2784843} \\{{0.2}3923145} & {{0.6}8739938} & {{0.0}7336917} & {{0.3}3094114} & {{0.1}4901541} & {{0.5}2004327} \\{{- {0.0}}001363} & {{0.0}4521596} & {{0.9}6599714} & {{0.4}7964602} & {{0.5}2900498} & {{0.0}0242485}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - C}$

Once this conversion is complete, the XYZ values are converted to ACESAP-0 using an XYZ-to-ACES matrix. This matrix is the inverse of theACES-to-XYZ matrix. The conversion from XYZ-to-ACES is shown below inthe following equation:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{{ACES}_{{AP}\; 0}} = {\begin{bmatrix}{{1.0}498110175} & 0 & {{- {0.0}}000974845} \\{{- {0.4}}959030231} & {{1.3}733130458} & {{0.0}982400361} \\0 & 0 & {{0.9}912520182}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}_{D\; 60_{ACES}}$

In one embodiment, the conversion process from ACES-to-6P makes use of amatrix conversion from RGB color data to five separate primary triads:an RGB primary triad, a CMY primary triad, an RMB primary triad, a BCGprimary triad, and a GYR primary triad. Once converted, the resultingtriads are evaluated by the system, wherein the system is operable toidentify instances where any value and/or component within a primarytriad is less than zero. When the system encounters an instance wherethe value and/or component within a specific primary triad is less thanzero, all of that specific primary triad's values are set to zero.

Next, the primary components of the triads are then added together on aper-component basis (e.g., {SUM(R), SUM(G), SUM(B), SUM(C), SUM(M),SUM(Y)}). For any ACES AP-0 value where color signal values for twoprimary triads are all non-negative, the sum of each primary componentis divided by two. It is not possible for more than two primary triadsto be completely non-negative. The result of this process is a set ofoutput data in 6P color space (RGBCMY).

If all of the RGBCMY triad values are negative, this color isout-of-gamut for 6P and must be gamut mapped to an in-gamut color. Inone embodiment, signals for the triad with the least-negative minimumvalue are used, with the negative signal values clipped to zero. Thesesignal values are then used on a per-component basis for eachout-of-gamut-signal.

FIG. 105 illustrates a process to validate the ACES-to-6P-to-ACESconversion process according to one embodiment of the present invention.First, a set of ISO chart values are defined in ACES for an ACES-to-XYZmatrix and XYZ-6P Primary Triads: XYZ-to-RGB, XYZ-to-CMY, XYZ-to-RMB,XYZ-to-BCG, and XYZ-to-GYR matrices. ISO chart values are then foundusing each of the previously mentioned triad matrices. Next, each triadmatrix is filtered, where any negative values are set to zero. Once thetriad matrices have been filtered, the triad values are merged, perprimary component (RGBCMY). If any of the merged colors have two triads(e.g., RGB and CMY), the values are divided by two (2) and merged backinto the matrices, resulting in a set of final 6P values. If the mergedcolors do not have two triads, this represents the set of final 6Pvalues. Then, the set of final 6P values is converted back to XYZ spaceusing a 6P-to-XYZ matrix. Once this conversion is complete, the XYZvalues are converted to ACES AP-0 using an inverse ACES-to-XYZ matrix.Upon completing the conversion to ACES AP-0, the recovered ACES colorsare subtracted from the original ACES ISO chart values. If thissubtraction results in a value other than zero, the entire conversionprocess is restarted. Otherwise, if the result is equal to zero, thisindicates that the conversion process is successful.

In one embodiment, the ISO 17321 matrix/chart values are defined using aperfect reflecting diffuser matrix (0.977840.977840.97784), an 18% greycard matrix (0.180.180.18), and the 24 patches of the ISO 17321-1 chart,as illuminated using CIE D60:

(0.11877 0.08709 0.05895), (0.40002 0.31916 0.23737),

(0.18476 0.20398 0.31311), (0.10901 0.13511 0.06493),

(0.26684 0.24604 0.40932), (0.32283 0.46208 0.40606),

(0.38606 0.22744 0.05777), (0.13822 0.13037 0.33703),

(0.30203 0.13752 0.12758), (0.0931 0.06347 0.13525),

(0.34876 0.43654 0.10614), (0.48656 0.36686 0.08061),

(0.08732 0.07443 0.27274), (0.15366 0.25691 0.09071),

(0.21742 0.0707 0.0513), (0.5892 0.53943 0.09157),

(0.30904 0.14818 0.27426), (0.14901 0.23378 0.35939),

(0.86653 0.86792 0.85818), (0.57356 0.57256 0.57169),

(0.35346 0.35337 0.35391), (0.20253 0.20243 0.20287),

(0.09467 0.0952 0.09637), (0.03745 0.03766 0.03895).

These are the ACES RICD values for a perfect reflecting diffuser, an 18%gray card, and the 24 patches of the ISO 17321-1 chart, as illuminatedusing CIE D60.

While the process shown in FIG. 105 is using the ACES RICD values for aperfect reflecting diffuser, an 18% gray card, and the 24 patches of theISO 17321-1 chart, as illuminated using CIE D60, it can be used tovalidate any conversion from ACES-to-6P-to-ACES.

It is important to note that 6P {1,1,1,1,1,1} converts to ACES-0{2,2,2}. In one embodiment using ITU-R BT.2100 color space, it isnecessary to perform a scaling operation of the linear display-referredRGB values, followed by applying an inverse Perceptual Quantizer (PQ)EOTF. The scaling is such that 6P data {1,1,1,1,1,1} maps to 10-bit PQ{668,668,668}. In one embodiment, the scaling maps at a rate of 403candelas per square meter (cd/m²).

Conversions from 6P

To convert from 6P-B to ITU-R BT.709, the following equation is used:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{709} = {\begin{bmatrix}{{0.3}65168600} & {{0.3}3841283} & {{0.2}42516274} & {{0.2}6436558} & {{0.2}9369917} & {{0.3}8803295} \\{{0.3}52831032} & {{0.4}7148253} & {{0.1}71580696} & {{0.2}9198386} & {{0.2}1036155} & {{0.4}9354884} \\{{0.0}75628779} & {{0.1}2632205} & {{0.9}70801672} & {{0.5}0105188} & {{0.5}7697077} & {{0.0}9472986}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - B}$

To convert from 6P-C (D65) to XYZ, the following equation is used:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix}_{D\; 65} = {\begin{bmatrix}{{0.4}8657095} & {{0.2}6566769} & {{0.1}9821729} & {{0.3}2295962} & {{- {0.5}}4969800} & {{1.1}77199435} \\{{0.2}2897456} & {{0.6}9173852} & {{0.0}7928691} & {{0.6}7867175} & {{- {0.2}}2203240} & {{0.5}43360700} \\{{0.0}0000000} & {{0.0}4511338} & {{1.0}4394437} & {{0.9}8336936} & {{- {0.7}}8858190} & {{0.8}94270250}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - C}$

To convert from 6P-C (D65) to SMPTE RP431, the following equation isused:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{431} = {\begin{bmatrix}{{1.0}93004357} & {{0.0}39719830} & {{0.9}19051622} & {{0.6}2218550} & {{- {1.6}}1925180} & {{3.0}4884206} \\{{- {0.0}}000228975} & {{0.9}58591190} & {{- {0.0}}000581437} & {{0.9}1215832} & {{0.0}4412971} & {{0.0}0222213} \\{{- {0.0}}000114487} & {{0.0}00014537} & {{1.1}50499374} & {{1.0}3644562} & {{- {0.8}}7134730} & {{0.9}8540413}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - C}$

To convert from 6P-C (D65) to ITU-R BT.2020/2100, the following equationis used:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{2020} = {\begin{bmatrix}{{- {0.7}}53833034} & {{- {0.1}}985974} & {{- {0.0}}47569597} & {{- {0.0}}638727} & {{0.6}6486929} & {{- {1.6}}009966} \\{{- {0.0}}45743849} & {{- {0.9}}417772} & {{- {0.0}}12478931} & {{- {0.8}}972543} & {{0.0}0487099} & {{- {0.1}}076167} \\{{0.0}0121034} & {{- {0.0}}176017} & {{- {0.9}}83608623} & {{- {0.9}}031051} & {{0.7}4312557} & {{- {0.8}}400205}\end{bmatrix}\begin{bmatrix}R \\G \\B \\C \\M \\Y\end{bmatrix}}_{{6P} - {C{({D65})}}}$

Conversions Between XYZ and Standard Gamuts

The color gamut for ITU-R BT.709-6 (2015), which is incorporated hereinby reference in its entirety, is described in table 1, row 1.3. Thedefinition of X, Y, Z is described in Joint ISO/CIE Standard ISO11664-3:2012(E)/CIE S 014-3/E:2011, which is incorporated herein byreference in its entirety. To convert between ITU-R BT.709-6 and XYZ,the following equation is used:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = {\begin{bmatrix}{{0.4}125} & {{0.3}576} & {{0.1}804} \\{{0.2}127} & {{0.7}152} & {{0.0}722} \\{{0.0}193} & {{0.1}192} & {{0.9}503}\end{bmatrix}\begin{bmatrix}R \\G \\B\end{bmatrix}}_{709}$

To convert between XYZ and ITU-R BT.709-6, the following equation isused:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{709} = {\begin{bmatrix}{{3.2}405} & {{- {1.5}}371} & {{- {0.4}}985} \\{{- {0.9}}693} & {{1.8}760} & {{0.0}416} \\{{0.0}556} & {{- {0.2}}040} & {{1.0}572}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}$

The color gamut for SMPTE RP431-2:2011, which is incorporated herein byreference in its entirety, is described in table A.1, row 7.8. Thedefinition of X, Y, Z is described in Joint ISO/CIE Standard ISO11664-3:2012(E)/CIE S 014-3/E:2011, which is incorporated herein byreference in its entirety. To convert between SMPTE RP431 and XYZ, thefollowing equation is used:

$\begin{bmatrix}X \\Y \\Z\end{bmatrix} = {\begin{bmatrix}{{0.4}452} & {{0.2}771} & {{0.1}723} \\{{0.2}095} & {{0.7}216} & {{0.0}689} \\0 & {{0.4}706} & {{0.9}074}\end{bmatrix}\begin{bmatrix}R \\G \\B\end{bmatrix}}_{{RP}\; 431}$

To convert between XYZ and SMPTE RP431, the following equation is used:

$\begin{bmatrix}R \\G \\B\end{bmatrix}_{{RP}\; 431} = {\begin{bmatrix}{{2.7}254} & {{- {1.0}}180} & {{- {0.4}}402} \\{{- {0.7}}952} & {{1.6}897} & {{0.0}226} \\{{0.0}412} & {{- {0.0}}876} & {{1.1}009}\end{bmatrix}\begin{bmatrix}X \\Y \\Z\end{bmatrix}}$

Converting to a Five-Color Multiprimary Display

In one embodiment, the system is operable to convert image dataincorporating five primary colors. In one embodiment, the five primarycolors include Red (R), Green (G), Blue (G), Cyan (C), and Yellow (Y),collectively referred to as RGBCY. In another embodiment, the fiveprimary colors include Red (R), Green (G), Blue (B), Cyan (C), andMagenta (M), collectively referred to as RGBCM. In one embodiment, thefive primary colors do not include Magenta (M).

In one embodiment, the five primary colors include Red (R), Green (G),Blue (B), Cyan (C), and Orange (O), collectively referred to as RGBCO.RGBCO primaries provide optimal spectral characteristics, transmittancecharacteristics, and makes use of a D65 white point. See, e.g.,Moon-Cheol Kim et al., Wide Color Gamut Five Channel Multi-Primary forHDTV Application, Journal of Imaging Sci. & Tech. Vol. 49, No. 6,November/December 2005, at 594-604, which is hereby incorporated byreference in its entirety.

In one embodiment, a five-primary color model is expressed as F=M·C,where F is equal to a tristimulus color vector, F=(X, Y, Z)^(T), and Cis equal to a linear display control vector, C=(C1, C2, C3, C4, C5)^(T).Thus, a conversion matrix for the five-primary color model isrepresented as

$M = \begin{pmatrix}X_{1} & X_{2} & X_{3} & X_{4} & X_{5} \\Y_{1} & Y_{2} & Y_{3} & Y_{4} & Y_{5} \\Z_{1} & Z_{2} & Z_{3} & Z_{4} & Z_{5}\end{pmatrix}$

Using the above equation and matrix, a gamut volume is calculated for aset of given control vectors on the gamut boundary. The control vectorsare converted into CIELAB uniform color space. However, because matrix Mis non-square, the matrix inversion requires splitting the color gamutinto a specified number of pyramids, with the base of each pyramidrepresenting an outer surface and where the control vectors arecalculated using linear equation for each given XYZ triplet presentwithin each pyramid. By separating regions into pyramids, the conversionprocess is normalized. In one embodiment, a decision tree is created inorder to determine which set of primaries are best to define a specifiedcolor. In one embodiment, a specified color is defined by multiple setsof primaries. In order to locate each pyramid, 2D chromaticity look-uptables are used, with corresponding pyramid numbers for inputchromaticity values in xy or u′v′. Typical methods using pyramidsrequire 1000×1000 address ranges in order to properly search theboundaries of adjacent pyramids with look-up table memory. The system ofthe present invention uses a combination of parallel processing foradjacent pyramids and at least one algorithm for verifying solutions bychecking constraint conditions. In one embodiment, the system uses aparallel computing algorithm. In one embodiment, the system uses asequential algorithm. In another embodiment, the system uses abrightening image transformation algorithm. In another embodiment, thesystem uses a darkening image transformation algorithm. In anotherembodiment, the system uses an inverse sinusoidal contrasttransformation algorithm. In another embodiment, the system uses ahyperbolic tangent contrast transformation algorithm. In yet anotherembodiment, the system uses a sine contrast transformation executiontimes algorithm. In yet another embodiment, the system uses a linearfeature extraction algorithm. In yet another embodiment, the system usesa JPEG2000 encoding algorithm. In yet another embodiment, the systemuses a parallelized arithmetic algorithm. In yet another embodiment, thesystem uses an algorithm other than those previously mentioned. In yetanother embodiment, the system uses any combination of theaforementioned algorithms.

Mapping a Six-Primary Color System into Standardized Transport Formats

Each encode and/or decode system fits into existing video serial datastreams that have already been established and standardized. This is keyto industry acceptance. Encoder and/or decoder designs require little orno modification for a six-primary color system to map to these standardserial formats.

FIG. 55 illustrates one embodiment of a six-primary color system mappingto an SMPTE ST424 standard serial format. The SMPTE ST424/ST425 set ofstandards allow very high sampling systems to be passed through a singlecable. This is done by using alternating data streams, each containingdifferent components of the image. For use with a six-primary colorsystem transport, image formats are limited to RGB due to the absence ofa method to send a full bandwidth Y signal.

The process for mapping a six-primary color system to an SMPTE ST425format is the same as mapping to an SMPTE ST424 format. To fit asix-primary color system into an SMPTE ST425/424 stream involves thefollowing substitutions: G′_(INT)+M′_(INT) is placed in the Green datasegments, R′_(INT)+C′_(INT) is placed in the Red data segments, andB′_(INT)+Y′_(INT) is placed into the Blue data segments. FIG. 56illustrates one embodiment of an SMPTE 4246P readout.

System 2 requires twice the data rate as System 1, so it is notcompatible with SMPTE 424. However, it maps easily into SMPTE ST2082using a similar mapping sequence. In one example, system 2 is used tohave the same data speed defined for 8K imaging to show a 4K image.

In one embodiment, sub-image and data stream mapping occur as shown inSMPTE ST2082. An image is broken into four sub-images, and eachsub-image is broken up into two data streams (e.g., sub-image 1 isbroken up into data stream 1 and data stream 2). The data streams areput through a multiplexer and then sent to the interface as shown inFIG. 114.

FIG. 57 and FIG. 58 illustrate serial digital interfaces for asix-primary color system using the SMPTE ST2082 standard. In oneembodiment, the six-primary color system data is RGBCYM data, which ismapped to the SMPTE ST2082 standard (FIG. 57). Data streams 1, 3, 5, and7 follow the pattern shown for data stream 1. Data streams 2, 4, 6, and8 follow the pattern shown for data stream 2. In one embodiment, thesix-primary color system data is Y_(RGB) Y_(CYM) C_(R) C_(B) C_(C) C_(Y)data, which is mapped to the SMPTE ST2082 standard (FIG. 58). Datastreams 1, 3, 5, and 7 follow the pattern shown for data stream 1. Datastreams 2, 4, 6, and 8 follow the pattern shown for data stream 2.

In one embodiment, the standard serial format is SMPTE ST292. SMPTEST292 is an older standard than ST424 and is a single wire format for1.5 GB video, whereas ST424 is designed for up to 3 GB video. However,while ST292 can identify the payload ID of SMPTE ST352, it isconstrained to only accepting an image identified by a hex value, 0h.All other values are ignored. Due to the bandwidth and identificationslimitations in ST292, a component video six-primary color systemincorporates a full bit level luminance component. To fit a six-primarycolor system into an SMPTE ST292 stream involves the followingsubstitutions: E′_(Y) ₆ _(-INT) is placed in the Y data segments,E′_(Cb-INT)+E′_(Cy-INT) is placed in the Cb data segments, andE′_(Cr-INT)+E′_(Cc-INT) is placed in the Cr data segments. In anotherembodiment, the standard serial format is SMPTE ST352.

SMPTE ST292 and ST424 Serial Digital Interface (SDI) formats includepayload identification (ID) metadata to help the receiving deviceidentify the proper image parameters. The tables for this needmodification by adding at least one flag identifying that the imagesource is a six-primary color RGB image. Therefore, six-primary colorsystem format additions need to be added. In one embodiment, thestandard is the SMPTE ST352 standard.

FIG. 59 illustrates one embodiment of an SMPTE ST2926P mapping. FIG. 60illustrates one embodiment of an SMPTE ST2926P readout.

FIG. 61 illustrates modifications to the SMPTE ST352 standards for asix-primary color system. Hex code “Bh” identifies a constant luminancesource and flag “Fh” indicates the presence of a six-primary colorsystem. In one embodiment, Fh is used in combination with at least oneother identifier located in byte 3. In another embodiment, the Fh flagis set to 0 if the image data is formatted as System 1 and the Fh flagis set to 1 if the image data is formatted as System 2.

In another embodiment, the standard serial format is SMPTE ST2082. Wherea six-primary color system requires more data, it may not always becompatible with SMPTE ST424. However, it maps easily into SMPTE ST2082using the same mapping sequence. This usage would have the same dataspeed defined for 8K imaging in order to display a 4K image.

In another embodiment, the standard serial format is SMPTE ST2022.Mapping to ST2022 is similar to mapping to ST292 and ST242, but as anETHERNET format. The output of the stacker is mapped to the mediapayload based on Real-time Transport Protocol (RTP) 3550, established bythe Internet Engineering Task Force (IETF). RTP provides end-to-endnetwork transport functions suitable for applications transmittingreal-time data, including, but not limited to, audio, video, and/orsimulation data, over multicast or unicast network services. The datatransport is augmented by a control protocol (RTCP) to allow monitoringof the data delivery in a manner scalable to large multicast networks,and to provide control and identification functionality. There are nochanges needed in the formatting or mapping of the bit packing describedin SMPTE ST 2022-6: 2012 (HBRMT).

FIG. 62 illustrates one embodiment of a modification for a six-primarycolor system using the SMPTE ST2202 standard. For SMPTE ST2202-6:2012(HBRMT), there are no changes needed in formatting or mapping of the bitpacking. ST2022 relies on header information to correctly configure themedia payload. Parameters for this are established within the payloadheader using the video source format fields including, but not limitedto, MAP, FRAME, FRATE, and/or SAMPLE. MAP, FRAME, and FRATE remain asdescribed in the standard. MAP is used to identify if the input is ST292or ST425 (RGB or Y Cb Cr). SAMPLE is operable for modification toidentify that the image is formatted as a six-primary color systemimage. In one embodiment, the image data is sent using flag “0h”(unknown/unspecified).

In another embodiment, the standard is SMPTE ST2110. SMPTE ST2110 is arelatively new standard and defines moving video through an Internetsystem. The standard is based on development from the IETF and isdescribed under RFC3550. Image data is described through “pgroup”construction. Each pgroup consists of an integer number of octets. Inone embodiment, a sample definition is RGB or YCbCr and is described inmetadata. In one embodiment, the metadata format uses a SessionDescription Protocol (SDP) format. Thus, pgroup construction is definedfor 4:4:4, 4:2:2, and 4:2:0 sampling as 8-bit, 10-bit, 12-bit, and insome cases 16-bit and 16-bit floating point wording. In one embodiment,six-primary color image data is limited to a 10-bit depth. In anotherembodiment, six-primary color image data is limited to a 12-bit depth.Where more than one sample is used, it is described as a set. Forexample, 4:4:4 sampling for blue, as a non-linear RGB set, is describedas C0′B, C1′B, C2′B, C3′B, and C4′B. The lowest number index being leftmost within the image. In another embodiment, the method of substitutionis the same method used to map six-primary color content into the ST2110standard.

In another embodiment, the standard is SMPTE ST2110. SMPTE ST2110-20describes the construction for each pgroup. In one embodiment,six-primary color system content arrives for mapping as non-linear datafor the SMPTE ST2110 standard. In another embodiment, six-primary colorsystem content arrives for mapping as linear data for the SMPTE ST2110standard.

FIG. 63 illustrates a table of 4:4:4 sampling for a six-primary colorsystem for a 10-bit video system. For 4:4:410-bit video, 15 octets areused and cover 4 pixels.

FIG. 64 illustrates a table of 4:4:4 sampling for a six-primary colorsystem for a 12-bit video system. For 4:4:412-bit video, 9 octets areused and cover 2 pixels before restarting the sequence.

Non-linear GRBMYC image data would arrive as: G′_(INT)+M′_(INT),R′_(INT)+C′_(INT), and B′_(INT)+Y′_(INT). Component substitution wouldfollow what has been described for SMPTE ST424, where G′_(INT)+M′_(INT)is placed in the Green data segments, R′_(INT)+C′_(INT) is placed in theRed data segments, and B′_(INT)+Y′_(INT) is placed in the Blue datasegments. The sequence described in the standard is shown as R0′, G0′,B0′, R1′, G1′, B1′, etc.

FIG. 65 illustrates sequence substitutions for 10-bit and 12-bit videoin 4:2:2 sampling systems in a Y Cb Cr Cc Cy color space. Components aredelivered to a 4:2:2 pgroup including, but not limited to, E′_(Y6-INT),E′_(Cb-INT)+E′_(Cy-INT), and E′_(Cr-INT)+E′_(Cc-INT). For 4:2:210-bitvideo, 5 octets are used and cover 2 pixels before restarting thesequence. For 4:2:212-bit video, 6 octets are used and cover 2 pixelsbefore restarting the sequence. Component substitution follows what hasbeen described for SMPTE ST292, where E′_(Y6-INT) is placed in the Ydata segments, E′_(Cb-INT)+E′_(Cy-INT) is placed in the Cb datasegments, and E′_(Cr-INT)+E′_(Cc-INT) is placed in the Cr data segments.The sequence described in the standard is shown as Cb0′, Y0′, Cr0′, Y1′,Cr1′, Y3′, Cb2′, Y4′, Cr2′, Y5′, etc. In another embodiment, the videodata is represented at a bit level other than 10-bit or 12-bit. Inanother embodiment, the sampling system is a sampling system other than4:2:2. In another embodiment, the standard is STMPE ST2110.

FIG. 66 illustrates sample placements of six-primary system componentsfor a 4:2:2 sampling system image. This follows the substitutionsillustrated in FIG. 65, using a 4:2:2 sampling system.

FIG. 67 illustrates sequence substitutions for 10-bit and 12-bit videoin 4:2:0 sampling systems using a Y Cb Cr Cc Cy color space. Componentsare delivered to a pgroup including, but not limited to, E′_(Y6-INT),E′_(Cb-INT)+E′_(Cy-INT), and E′_(Cr-INT)+E′_(Cc-INT). For 4:2:0 10-bitvideo data, 15 octets are used and cover 8 pixels before restarting thesequence. For 4:2:0 12-bit video data, 9 octets are used and cover 4pixels before restarting the sequence. Component substitution followswhat is described in SMPTE ST292 where E′_(Y6-INT) is placed in the Ydata segments, E′_(Cb-INT)+E′_(Cy-INT) is placed in the Cb datasegments, and E′_(Cr-INT)+E′_(Cc-INT) is placed in the Cr data segments.The sequence described in the standard is shown as Y′00, Y′01, Y′, etc.

FIG. 68 illustrates sample placements of six-primary system componentsfor a 4:2:0 sampling system image. This follows the substitutionsillustrated in FIG. 67, using a 4:2:0 sampling system.

FIG. 69 illustrates modifications to SMPTE ST2110-20 for a 10-bitsix-primary color system in 4:4:4 video. SMPTE ST2110-20 describes theconstruction of each “pgroup”. Normally, six-primary color system dataand/or content would arrive for mapping as non-linear. However, with thepresent system there is no restriction on mapping data and/or content.For 4:4:4, 10-bit video, 15 octets are used and cover 4 pixels beforerestarting the sequence. Non-linear, six-primary color system image datawould arrive as G′_(INT), B′_(INT), R′_(INT), M′_(INT), Y′_(INT), andC′_(INT). The sequence described in the standard is shown as R0′, G0′,B0′, R1′, G1′, B1′, etc.

FIG. 70 illustrates modifications to SMPTE ST2110-20 for a 12-bitsix-primary color system in 4:4:4 video. For 4:4:4, 12-bit video, 9octets are used and cover 2 pixels before restarting the sequence.Non-linear, six-primary color system image data would arrive asG′_(INT), B′_(INT), R′_(INT), M′_(INT), Y′_(INT), and C′_(INT). Thesequence described in the standard is shown as R0′, G0′, B0′, R1′, G1′,B1′, etc.

FIG. 71 illustrates modifications to SMPTE ST2110-20 for a 10-bit sixprimary color system in 4:2:2 video. Components that are delivered to anSMPTE ST2110 pgroup include, but are not limited to, E′_(Yrgb-INT),E′_(Ycym-INT), E′_(Cb-INT), E′_(Cr-INT), E′_(Cy-INT), and E′_(Cc-INT).For 4:2:2, 10-bit video, 5 octets are used and cover 2 pixels beforerestarting the sequence. For 4:2:2:2, 12-bit video, 6 octets are usedand cover 2 pixels before restarting the sequence. Componentsubstitution follows what is described for SMPTE ST292, whereE′_(Yrgb-INT) or E′_(Ycym-INT) are placed in the Y data segments,E′_(Cr-INT) or E′_(Cc-INT) are placed in the Cr data segments, andE′_(Cb-INT) or E′_(Cy-INT) are placed in the Cb data segments. Thesequence described in the standard is shown as Cb′0, Y′0, Cr′0, Y′1,Cb′1, Y′2, Cr′1, Y′3, Cb′2, Y′4, Cr′2, etc.

FIG. 72 illustrates modifications to SMPTE ST2110-20 for a 12-bitsix-primary color system in 4:2:0 video. Components that are deliveredto an SMPTE ST2110 pgroup are the same as with the 4:2:2 method. For4:2:0, 10-bit video, 15 octets are used and cover 8 pixels beforerestarting the sequence. For 4:2:0, 12-bit video, 9 octets are used andcover 4 pixels before restarting the sequence. Component substitutionfollows what is described for SMPTE ST292, where E′_(Yrgb-INT) orE′_(Ycym-INT) are placed in the Y data segments, E′_(Cr-INT) orE′_(Cc-INT) are placed in the Cr data segments, and E′_(Cb-INT) orE′_(Cy-INT) are placed in the Cb data segments. The sequence describedin the standard is shown as Y′00, Y′01, Y′, etc.

Table 24 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 and 4:2:0:2:0sampling for System 1 and Table 25 summaries mapping to SMPTE ST2110 for4:4:4:4:4:4 sampling (linear and non-linear) for System 1.

TABLE 24 Pgroup Sampling Bit Depth Octets Pixels Y PbPr Sample Order 6PSample Order 4:2:2:2:2 8 4 2 C_(B)′, Y0′, C_(R)′, Y1′ 10 5 2 C_(B)′,Y0′, C_(R)′, Y1′ C_(B)′ + C_(Y)′, Y0′, C_(R)′ + C_(C)′, Y1′ 12 6 2C_(B)′, Y0′, C_(R)′, Y1′ C_(B)′ + C_(Y)′, Y0′, C_(R)′ + C_(C)′, Y1′ 16,16f 8 2 C′_(B), Y′0, C′_(R), Y′1 C_(B)′ + C_(Y)′, Y0′, C_(R)′ + C_(C)′,Y1′ 4:2:0:2:0 8 6 4 Y′00, Y′01, Y′10, Y′11, C_(B)′00, C_(R)′00 10 15 8Y′00, Y′01, Y′10, Y′11, C_(B)′00, Y′00, Y′01, Y′10, Y′11, C_(B)′00 +C_(Y)′00, C_(R)′00 C_(R)′00 + C_(C)′00 Y′02, Y′03, Y′12, Y′13, C_(B)′01,Y′02, Y′03, Y′12, Y′13, C_(B)′01 + C_(Y)′01, C_(R)′01 C_(R)′01 +C_(C)′01 12 9 4 Y′00, Y′01, Y′10, Y′11, C_(B)′00, Y′00, Y′01, Y′10,Y′11, C_(B)′00 + C_(Y)′00, C_(R)′00 C_(R)′00 + C_(C)′00

TABLE 25 pgroup Sampling Bit Depth Octets pixels RGB Sample Order 6PSample Order 4:4:4:4:4:4  8 3 1 R, G, B Linear 10 15 4 R0, G0, B0, R1,R + C0, G + M0, G1, B1, R2, G2, B2 B + Y0, R + C1, G + M1, B + Y1, R +C2, G + M2, B + Y2 12 9 2 R0, G0, B0, R1, R + C0, G + M0, G1, B1 B + Y0,R + C1, G + M1, B + Y1 16, 16f 6 1 R, G, B R + C, G + M, B + Y4:4:4:4:4:4  8 3 1 R′, G′, B′ Non-Linear 10 15 4 R0′, G0′, B0′, R′ +C′0, G′ + R1′, G1′, B1′, M′0, B′ + Y′0, R′ + C′1, R2′, G2′, B2′ G′ +M′1, B′ + Y′1, R′ + C′2, G′ + M′2, B′ + Y′2 12 9 2 R0′, G0′, B0′, R′ +C′0, G′ + R1′, G1′, B1′ M′0, B′ + Y′0, R′ + C′1, G′ + M′1, B′ + Y′1 16,16f 6 1 R′, G′, B′ R′ + C′, G′ + M′, B′ + Y′

Table 26 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 sampling forSystem 2 and Table 27 summaries mapping to SMPTE ST2110 for 4:4:4:4:4:4sampling (linear and non-linear) for System 2.

TABLE 26 pgroup Sampling Bit Depth Octets pixels Y PbPr Sample Order 6PSample Order 4:2:2:2:2 8 8 2 C_(B)′, Y0′, C_(B)′, C_(Y)′, C_(R)′, Y1′Y_(RGB)0′, C_(R)′, C_(C)′, Y_(CMY)0′ C_(B)′, C_(Y)′, Y_(RGB)1′ 10 10 2C_(B)′, Y0′, C_(B)′, C_(Y)′, C_(R)′, Y1′ Y_(RGB)0′, C_(R)′, C_(C)′,Y_(CMY)0′ C_(B)′, C_(Y)′, Y_(RGB)1′ 12 12 2 C_(B)′, Y0′, C_(B)′, C_(Y)′,C_(R)′, Y1′ Y_(RGB)0′, C_(R)′, C_(C)′, Y_(CMY)0′ C_(B)′, C_(Y)′,Y_(RGB)1′ 16, 16f 16 2 C′_(B), Y′0, C_(B)′, C_(Y)′, C′_(B), Y′1Y_(RGB)0′, C_(R)′, C_(C)′, Y_(CMY)0′ C_(B)′, C_(Y)′, Y_(RGB)1′

TABLE 27 Pgroup Sampling Bit Depth octets pixels RGB Sample Order 6PSample Order 4:4:4:4:4:4  8 3 1 R, G, B R, C, G, M, B, Y Linear 10 15 4R0, G0, B0, R0, C0, G0, M0, B0, R1, G1, B1, Y0, R1, C1, G1, M1, B1, Y1,R2, G2, B2 R2, C2, G2, M2, B2 + Y2 12 9 2 R0, G0, B0, R0, C0, G0, M0,B0, R1, G1, B1 Y0, R1, C1, G1, M1, B1, Y1 16, 16f 6 1 R, G, B R, C, G,M, B, Y 4:4:4:4:4:4  8 3 1 R′, G′, B′ R′, C′, G′, Non-Linear M′, B′, Y′10 15 4 R0′, G0′, B0′, R0′, C0′, G0′, M0′, R1′, G1′, B1′, B0′, Y0′, R1′,C1′, R2′, G2′, B2′ G1′, M1′, B1′, Y1′, R2′, C2′, G2′, M2′, B2′ + Y2′ 129 2 R0′, G0′, B0′, R0′, C0′, G0′, M0′, R1′, G1′, B1′ B0′, Y0′, R1′, C1′,G1′, M1′, B1′, Y1′ 16, 16f 6 1 R′, G′, B′ R′, C′, G′, M′, B′, Y′

Session Description Protocol (SDP) Modification for a Six-Primary ColorSystem

SDP is derived from IETF RFC 4566 which sets parameters including, butnot limited to, bit depth and sampling parameters. In one embodiment,SDP parameters are contained within the RTP payload. In anotherembodiment, SDP parameters are contained within the media format andtransport protocol. This payload information is transmitted as text.Therefore, modifications for the additional sampling identifiersrequires the addition of new parameters for the sampling statement. SDPparameters include, but are not limited to, color channel data, imagedata, framerate data, a sampling standard, a flag indicator, an activepicture size code, a timestamp, a clock frequency, a frame count, ascrambling indicator, and/or a video format indicator. For non-constantluminance imaging, the additional parameters include, but are notlimited to, RGBCYM-4:4:4, YBRCY-4:2:2, and YBRCY-4:2:0. For constantluminance signals, the additional parameters include, but are notlimited to, CLYBRCY-4:2:2 and CLYBRCY-4:2:0.

Additionally, differentiation is included with the colorimetryidentifier in one embodiment. For example, 6PB1 defines 6P with a colorgamut limited to ITU-R BT.709 formatted as system 1, 6PB2 defines 6Pwith a color gamut limited to ITU-R BT.709 formatted as system 2, 6PB3defines 6P with a color gamut limited to ITU-R BT.709 formatted assystem 3, 6PC1 defines 6P with a color gamut limited to SMPTE RP 431-2formatted as system 1, 6PC2 defines 6P with a color gamut limited toSMPTE RP 431-2 formatted as system 2, 6PC3 defines 6P with a color gamutlimited to SMPTE RP 431-2 formatted as system 3, 6PS1 defines 6P with acolor gamut as Super 6P formatted as system 1, 6PS2 defines 6P with acolor gamut as Super 6P formatted as system 2, and 6PS3 defines 6P witha color gamut as Super 6P formatted as system 3.

Colorimetry can also be defined between a six-primary color system usingthe ITU-R BT.709-6 standard and the SMPTE ST431-2 standard, orcolorimetry can be left defined as is standard for the desired standard.For example, the SDP parameters for a 1920×1080 six-primary color systemusing the ITU-R BT.709-6 standard with a 10-bit signal as system 1 areas follows:

m=video 30000 RTP/AVP 112, a=rtpmap:112 raw/90000, a=fmtp:112,sampling=YBRCY-4:2:2, width=1920, height=1080,exactframerate=30000/1001, depth=10, TCS=SDR, colorimetry=6PB1,PM=2110GPM, SSN=ST2110-20:2017. In one embodiment, the six-primary colorsystem is integrated with a Consumer Technology Association (CTA)861-based system. CTA-861 establishes protocols, requirements, andrecommendations for the utilization of uncompressed digital interfacesby consumer electronics devices including, but not limited to, digitaltelevisions (DTVs), digital cable, satellite or terrestrial set-topboxes (STBs), and related peripheral devices including, but not limitedto, DVD players and/or recorders, and other related Sources or Sinks.

These systems are provided as parallel systems so that video content isparsed across several line pairs. This enables each video component tohave its own transition-minimized differential signaling (TMDS) path.TMDS is a technology for transmitting high-speed serial data and is usedby the Digital Visual Interface (DVI) and High-Definition MultimediaInterface (HDMI) video interfaces, as well as other digitalcommunication interfaces. TMDS is similar to low-voltage differentialsignaling (LVDS) in that it uses differential signaling to reduceelectromagnetic interference (EMI), enabling faster signal transferswith increased accuracy. In addition, TMDS uses a twisted pair for noisereduction, rather than a coaxial cable that is conventional for carryingvideo signals. Similar to LVDS, data is transmitted serially over thedata link. When transmitting video data, and using HDMI, three TMDStwisted pairs are used to transfer video data.

In such a system, each pixel packet is limited to 8 bits only. For bitdepths higher than 8 bits, fragmented packs are used. This arrangementis no different than is already described in the current CTA-861standard.

Based on CTA extension Version 3, identification of a six-primary colortransmission would be performed by the sink device (e.g., the monitor).Adding recognition of the additional formats would be flagged in the CTAData Block Extended Tag Codes (byte 3). Since codes 33 and above arereserved, any two bits could be used to identify that the format is RGB,RGBCYM, Y Cb Cr, or Y Cb Cr Cc Cy and/or identify System 1 or System 2.Should byte 3 define a six-primary sampling format, and where the block5 extension identifies byte 1 as ITU-R BT.709, then logic assigns as6P-B. However, should byte 4 bit 7 identify colorimetry as DCI-P3, thecolor gamut would be assigned as 6P-C.

In one embodiment, the system alters the AVI Infoframe Data to identifycontent. AVI Inforframe Data is shown in Table 10 of CTA 861-G. In oneembodiment, Y2=1, Y1=0, and Y0=0 identifies content as 6P 4:2:0:2:0. Inanother embodiment, Y2=1, Y1=0, and Y0=1 identifies content as Y Cr CbCc Cy. In yet another embodiment, Y2=1, Y1=1, and Y0=0 identifiescontent as RGBCMY.

Byte 2 C1=1, C0=1 identifies extended colorimetry in Table 11 of CTA861-G. Byte 3 EC2, EC1, EC0 identifies additional colorimetry extensionvalid in Table 13 of CTA 861-G. Table 14 of CTA 861-G reservesadditional extensions. In one embodiment, ACE3=1, ACE2=0, ACE1=0, andACE0=X identifies 6P-B. In one embodiment, ACE3=0, ACE2=1, ACE1=0, andACE0=X identifies 6P-C. In one embodiment, ACE3=0, ACE2=0, ACE1=1, andACE0=X identifies System 1. In one embodiment, ACE3=1, ACE2=1, ACE1=0,and ACE0=X identifies System 2.

FIG. 73 illustrates the current RGB sampling structure for 4:4:4sampling video data transmission. For HDMI 4:4:4 sampling, video data issent through three TMDS line pairs. FIG. 74 illustrates a six-primarycolor sampling structure, RGBCYM, using System 1 for 4:4:4 samplingvideo data transmission. In one embodiment, the six-primary colorsampling structure ucomplies with CTA 861-G, November 2016, ConsumerTechnology Association, which is incorporated herein by reference in itsentirety. FIG. 75 illustrates an example of System 2 to RGBCYM 4:4:4transmission. FIG. 76 illustrates current Y Cb Cr 4:2:2 samplingtransmission as non-constant luminance. FIG. 77 illustrates asix-primary color system (System 1) using Y Cr Cb Cc Cy 4:2:2 samplingtransmission as non-constant luminance. FIG. 78 illustrates an exampleof a System 2 to Y Cr Cb Cc Cy 4:2:2 Transmission as non-constantluminance. In one embodiment, the Y Cr Cb Cc Cy 4:2:2 samplingtransmission complies with CTA 861-G, November 2016, Consumer TechnologyAssociation. FIG. 79 illustrates current Y Cb Cr 4:2:0 samplingtransmission. FIG. 80 illustrates a six-primary color system (System 1)using Y Cr Cb Cc Cy 4:2:0 sampling transmission.

HDMI sampling systems include Extended Display Identification Data(EDID) metadata. EDID metadata describes the capabilities of a displaydevice to a video source. The data format is defined by a standardpublished by the Video Electronics Standards Association (VESA). TheEDID data structure includes, but is not limited to, manufacturer nameand serial number, product type, phosphor or filter type, timingssupported by the display, display size, luminance data, and/or pixelmapping data. The EDID data structure is modifiable and modificationrequires no additional hardware and/or tools.

EDID information is transmitted between the source device and thedisplay through a display data channel (DDC), which is a collection ofdigital communication protocols created by VESA. With EDID providing thedisplay information and DDC providing the link between the display andthe source, the two accompanying standards enable an informationexchange between the display and source.

In addition, VESA has assigned extensions for EDID. Such extensionsinclude, but are not limited to, timing extensions (00), additional timedata black (CEA EDID Timing Extension (02)), video timing blockextensions (VTB-EXT (10)), EDID 2.0 extension (20), display informationextension (DI-EXT (40)), localized string extension (LS-EXT (50)),microdisplay interface extension (MI-EXT (60)), display ID extension(70), display transfer characteristics data block (DTCDB (A7, AF, BF)),block map (F0), display device data block (DDDB (FF)), and/or extensiondefined by monitor manufacturer (FF).

In one embodiment, SDP parameters include data corresponding to apayload identification (ID) and/or EDID information.

Six-Primary Color System Display

FIG. 81 illustrates a dual stack LCD projection system for a six-primarycolor system. In one embodiment, the display is comprised of a dualstack of projectors. This display uses two projectors stacked on top ofone another or placed side by side. Each projector is similar, with theonly difference being the color filters in each unit. Refresh and pixeltimings are synchronized, enabling a mechanical alignment between thetwo units so that each pixel overlays the same position betweenprojector units. In one embodiment, the two projectors areLiquid-Crystal Display (LCD) projectors. In another embodiment, the twoprojectors are Digital Light Processing (DLP) projectors. In yet anotherembodiment, the two projectors are Liquid-Crystal on Silicon (LCOS)projectors. In yet another embodiment, the two projectors areLight-Emitting Diode (LED) projectors.

In one embodiment, the display is comprised of a single projector. Asingle projector six-primary color system requires the addition of asecond cross block assembly for the additional colors. One embodiment ofa single projector (e.g., single LCD projector) is shown in FIG. 82. Asingle projector six-primary color system includes a cyan dichroicmirror, an orange dichroic mirror, a blue dichroic mirror, a reddichroic mirror, and two additional standard mirrors. In one embodiment,the single projector six-primary color system includes at least sixmirrors. In another embodiment, the single projector six-primary colorsystem includes at least two cross block assembly units.

FIG. 83 illustrates a six-primary color system using a single projectorand reciprocal mirrors. In one embodiment, the display is comprised of asingle projector unit working in combination with at first set of atleast six reciprocal mirrors, a second set of at least six reciprocalmirrors, and at least six LCD units. Light from at least one lightsource emits towards the first set of at least six reciprocal mirrors.The first set of at least six reciprocal mirrors reflects light towardsat least one of the at least six LCD units. The at least six LCD unitsinclude, but are not limited to, a Green LCD, a Yellow LCD, a Cyan, LCD,a Red LCD, a Magenta LCD, and/or a Blue LCD. Output from each of the atleast six LCDs is received by the second set of at least six reciprocalmirrors. Output from the second set of at least six reciprocal mirrorsis sent to the single projector unit. Image data output by the singleprojector unit is output as a six-primary color system. In anotherembodiment, there are more than two sets of reciprocal mirrors. Inanother embodiment, more than one projector is used.

In another embodiment, the display is comprised of a dual stack DigitalMicromirror Device (DMD) projector system. FIG. 84 illustrates oneembodiment of a dual stack DMD projector system. In this system, twoprojectors are stacked on top of one another. In one embodiment, thedual stack DMD projector system uses a spinning wheel filter. In anotherembodiment, the dual stack DMD projector system uses phosphortechnology. In one embodiment, the filter systems are illuminated by axenon lamp. In another embodiment, the filter system uses a blue laserilluminator system. Filter systems in one projector are RGB, while thesecond projector uses a CYM filter set. The wheels for each projectorunit are synchronized using at least one of an input video sync or aprojector to projector sync, and timed so that the inverted colors areoutput of each projector at the same time.

In one embodiment, the projectors are phosphor wheel systems. A yellowphosphor wheel spins in time with a DMD imager to output sequential RG.The second projector is designed the same, but uses a cyan phosphorwheel. The output from this projector becomes sequential BG. Combined,the output of both projectors is YRGGCB. Magenta is developed bysynchronizing the yellow and cyan wheels to overlap the flashing DMD.

In another embodiment, the display is a single DMD projector solution. Asingle DMD device is coupled with an RGB diode light source system. Inone embodiment, the DMD projector uses LED diodes. In one embodiment,the DMD projector includes CYM diodes. In another embodiment, the DMDprojector creates CYM primaries using a double flashing technique. FIG.85 illustrates one embodiment of a single DMD projector solution.

FIG. 86 illustrates one embodiment of a six-primary color system using awhite OLED display. In yet another embodiment, the display is a whiteOLED monitor. Current emissive monitor and/or television designs use awhite emissive OLED array covered by a color filter. Changes to thistype of display only require a change to pixel indexing and new sixcolor primary filters. Different color filter arrays are used, placingeach subpixel in a position that provides the least light restrictions,color accuracy, and off axis display.

FIG. 87 illustrates one embodiment of an optical filter array for awhite OLED display.

FIG. 88 illustrates one embodiment of a matrix of an LCD drive for asix-primary color system with a backlight illuminated LCD monitor. Inyet another embodiment, the display is a backlight illuminated LCDdisplay. The design of an LCD display involves adding the CYM subpixels.Drives for these subpixels are similar to the RGB matrix drives. Withthe advent of 8K LCD televisions, it is technically feasible to changethe matrix drive and optical filter and have a 4K six-primary color TV.

FIG. 89 illustrates one embodiment of an optical filter array for asix-primary color system with a backlight illuminated LCD monitor. Theoptical filter array includes the additional CYM subpixels.

In yet another embodiment, the display is a direct emissive assembleddisplay. The design for a direct emissive assembled display includes amatrix of color emitters grouped as a six-color system. Individualchannel inputs drive each Quantum Dot (QD) element illuminator and/ormicro LED element.

FIG. 90 illustrates an array for a Quantum Dot (QD) display device.

FIG. 91 illustrates one embodiment of an array for a six-primary colorsystem for use with a direct emissive assembled display.

FIG. 92 illustrates one embodiment of a six-primary color system in anemissive display that does not incorporate color filtered subpixels. ForLCD and WOLED displays, this can be modified for a six-primary colorsystem by expanding the RGB or WRGB filter arrangement to an RGBCYMmatrix. For WRGB systems, the white subpixel could be removed as theluminance of the three additional primaries will replace it. SDI videois input through an SDI decoder. In one embodiment, the SDI decoderoutputs to a Y CrCbCcCy-RGBCYM converter. The converter outputs RGBCYMdata, with the luminance component (Y) subtracted. RGBCYM data is thenconverted to RGB data. This RGB data is sent to a scale sync generationcomponent, receives adjustments to image controls, contrast, brightness,chroma, and saturation, is sent to a color correction component, andoutput to the display panel as LVDS data. In another embodiment the SDIdecoder outputs to an SDI Y-R switch component. The SDI Y-R switchcomponent outputs RGBCYM data. The RGBCYM data is sent to a scale syncgeneration component, receives adjustments to image controls, contrast,brightness, chroma, and saturation, is sent to a color correctioncomponent, and output to a display panel as LVDS data.

FIG. 115 is a schematic diagram of an embodiment of the inventionillustrating a computer system, generally described as 800, having anetwork 810, a plurality of computing devices 820, 830, 840, a server850, and a database 870.

The server 850 is constructed, configured, and coupled to enablecommunication over a network 810 with a plurality of computing devices820, 830, 840. The server 850 includes a processing unit 851 with anoperating system 852. The operating system 852 enables the server 850 tocommunicate through network 810 with the remote, distributed userdevices. Database 870 may house an operating system 872, memory 874, andprograms 876.

In one embodiment of the invention, the system 800 includes a network810 for distributed communication via a wireless communication antenna812 and processing by at least one mobile communication computing device830. Alternatively, wireless and wired communication and connectivitybetween devices and components described herein include wireless networkcommunication such as WI-FI, WORLDWIDE INTEROPERABILITY FOR MICROWAVEACCESS (WIMAX), Radio Frequency (RF) communication including RFidentification (RFID), NEAR FIELD COMMUNICATION (NFC), BLUETOOTHincluding BLUETOOTH LOW ENERGY (BLE), ZIGBEE, Infrared (IR)communication, cellular communication, satellite communication,Universal Serial Bus (USB), Ethernet communications, communication viafiber-optic cables, coaxial cables, twisted pair cables, and/or anyother type of wireless or wired communication. In another embodiment ofthe invention, the system 800 is a virtualized computing system capableof executing any or all aspects of software and/or applicationcomponents presented herein on the computing devices 820, 830, 840. Incertain aspects, the computer system 800 may be implemented usinghardware or a combination of software and hardware, either in adedicated computing device, or integrated into another entity, ordistributed across multiple entities or computing devices.

By way of example, and not limitation, the computing devices 820, 830,840 are intended to represent various forms of electronic devicesincluding at least a processor and a memory, such as a server, bladeserver, mainframe, mobile phone, personal digital assistant (PDA),smartphone, desktop computer, notebook computer, tablet computer,workstation, laptop, and other similar computing devices. The componentsshown here, their connections and relationships, and their functions,are meant to be exemplary only, and are not meant to limitimplementations of the invention described and/or claimed in the presentapplication.

In one embodiment, the computing device 820 includes components such asa processor 860, a system memory 862 having a random access memory (RAM)864 and a read-only memory (ROM) 866, and a system bus 868 that couplesthe memory 862 to the processor 860. In another embodiment, thecomputing device 830 may additionally include components such as astorage device 890 for storing the operating system 892 and one or moreapplication programs 894, a network interface unit 896, and/or aninput/output controller 898. Each of the components may be coupled toeach other through at least one bus 868. The input/output controller 898may receive and process input from, or provide output to, a number ofother devices 899, including, but not limited to, alphanumeric inputdevices, mice, electronic styluses, display units, touch screens, signalgeneration devices (e.g., speakers), or printers.

By way of example, and not limitation, the processor 860 may be ageneral-purpose microprocessor (e.g., a central processing unit (CPU)),a graphics processing unit (GPU), a microcontroller, a Digital SignalProcessor (DSP), an Application Specific Integrated Circuit (ASIC), aField Programmable Gate Array (FPGA), a Programmable Logic Device (PLD),a controller, a state machine, gated or transistor logic, discretehardware components, or any other suitable entity or combinationsthereof that can perform calculations, process instructions forexecution, and/or other manipulations of information.

In another implementation, shown as 840 in FIG. 115 multiple processors860 and/or multiple buses 868 may be used, as appropriate, along withmultiple memories 862 of multiple types (e.g., a combination of a DSPand a microprocessor, a plurality of microprocessors, one or moremicroprocessors in conjunction with a DSP core).

Also, multiple computing devices may be connected, with each deviceproviding portions of the necessary operations (e.g., a server bank, agroup of blade servers, or a multi-processor system). Alternatively,some steps or methods may be performed by circuitry that is specific toa given function.

According to various embodiments, the computer system 800 may operate ina networked environment using logical connections to local and/or remotecomputing devices 820, 830, 840 through a network 810. A computingdevice 830 may connect to a network 810 through a network interface unit896 connected to a bus 868. Computing devices may communicatecommunication media through wired networks, direct-wired connections orwirelessly, such as acoustic, RF, or infrared, through an antenna 897 incommunication with the network antenna 812 and the network interfaceunit 896, which may include digital signal processing circuitry whennecessary. The network interface unit 896 may provide for communicationsunder various modes or protocols.

In one or more exemplary aspects, the instructions may be implemented inhardware, software, firmware, or any combinations thereof. A computerreadable medium may provide volatile or non-volatile storage for one ormore sets of instructions, such as operating systems, data structures,program modules, applications, or other data embodying any one or moreof the methodologies or functions described herein. The computerreadable medium may include the memory 862, the processor 860, and/orthe storage media 890 and may be a single medium or multiple media(e.g., a centralized or distributed computer system) that store the oneor more sets of instructions 900. Non-transitory computer readable mediaincludes all computer readable media, with the sole exception being atransitory, propagating signal per se. The instructions 900 may furtherbe transmitted or received over the network 810 via the networkinterface unit 896 as communication media, which may include a modulateddata signal such as a carrier wave or other transport mechanism andincludes any deliver media. The term “modulated data signal” means asignal that has one or more of its characteristics changed or set in amanner as to encode information in the signal.

Storage devices 890 and memory 862 include, but are not limited to,volatile and non-volatile media such as cache, RAM, ROM, EPROM, EEPROM,FLASH memory, or other solid state memory technology, discs (e.g.,digital versatile discs (DVD), HD-DVD, BLU-RAY, compact disc (CD), orCD-ROM) or other optical storage; magnetic cassettes, magnetic tape,magnetic disk storage, floppy disks, or other magnetic storage devices;or any other medium that can be used to store the computer readableinstructions and which can be accessed by the computer system 800.

In one embodiment, the computer system 800 is within a cloud-basednetwork. In one embodiment, the server 850 is a designated physicalserver for distributed computing devices 820, 830, and 840. In oneembodiment, the server 850 is a cloud-based server platform. In oneembodiment, the cloud-based server platform hosts serverless functionsfor distributed computing devices 820, 830, and 840.

In another embodiment, the computer system 800 is within an edgecomputing network. The server 850 is an edge server, and the database870 is an edge database. The edge server 850 and the edge database 870are part of an edge computing platform. In one embodiment, the edgeserver 850 and the edge database 870 are designated to distributedcomputing devices 820, 830, and 840. In one embodiment, the edge server850 and the edge database 870 are not designated for computing devices820, 830, and 840. The distributed computing devices 820, 830, and 840are connected to an edge server in the edge computing network based onproximity, availability, latency, bandwidth, and/or other factors.

It is also contemplated that the computer system 800 may not include allof the components shown in FIG. 115 may include other components thatare not explicitly shown in FIG. 115 or may utilize an architecturecompletely different than that shown in FIG. 115. The variousillustrative logical blocks, modules, elements, circuits, and algorithmsdescribed in connection with the embodiments discussed herein may beimplemented as electronic hardware, computer software, or combinationsof both. To clearly illustrate the interchangeability of hardware andsoftware, various illustrative components, blocks, modules, circuits,and steps have been described above generally in terms of theirfunctionality. Whether such functionality is implemented as hardware orsoftware depends upon the particular application and design constraintsimposed on the overall system. Skilled artisans may implement thedescribed functionality in varying ways for each particular application(e.g., arranged in a different order or positioned in a different way),but such implementation decisions should not be interpreted as causing adeparture from the scope of the present invention.

The above-mentioned examples are provided to serve the purpose ofclarifying the aspects of the invention, and it will be apparent to oneskilled in the art that they do not serve to limit the scope of theinvention. By nature, this invention is highly adjustable, customizableand adaptable. The above-mentioned examples are just some of the manyconfigurations that the mentioned components can take on. Allmodifications and improvements have been deleted herein for the sake ofconciseness and readability but are properly within the scope of thepresent invention.

The invention claimed is:
 1. A system for displaying a six-primary colorsystem, comprising: a set of image data; a set of primary color signals,wherein the set of primary color signals corresponds to a set oftristimulus values in XYZ color space; an image data converter; a set ofSession Description Protocol (SDP) parameters; and at least one displaydevice; wherein the at least one display device and the image dataconverter are in network communication; wherein the image data converteris operable to create an updated set of primary color signals from theset of tri stimulus values in XYZ color space and a first primary triad,a second primary triad, a third primary triad, and a fourth primarytriad; wherein the set of image data includes a set of saturation data,wherein the set of saturation data is calculated using the updated setof primary color signals; wherein the set of saturation data is used tocreate an updated set of hue angles for the updated set of primary colorsignals, wherein the updated set of hue angles includes inverted hueangles; and wherein the image data converter is operable to convert theset of image data for display on the at least one display device usingthe updated set of primary color signals.
 2. The system of claim 1,wherein the first primary triad includes red (R), green (G), and blue(B) primaries, wherein the second primary triad includes G, cyan (C),and B primaries, wherein the third primary triad includes R, yellow (Y),and G primaries, and wherein the fourth primary triad includes R, B, andmagenta (M) primaries.
 3. The system of claim 1, wherein the firstprimary triad includes cyan (C), yellow (Y), and magenta (M) primaries.4. The system of claim 1, wherein the image data converter is operableto convert the set of tri stimulus values in XYZ color space into thefirst primary triad, the second primary triad, the third primary triad,and the fourth primary triad.
 5. The system of claim 1, wherein theupdated set of primary color signals is defined by the first primarytriad, the second primary triad, the third primary triad, and the fourthprimary triad.
 6. The system of claim 1, wherein the image dataconverter is operable to convert the set of tristimulus values in XYZcolor space into the first primary triad, the second primary triad, thethird primary triad, and the fourth primary triad in any order.
 7. Thesystem of claim 1, wherein the SDP parameters are modifiable, whereinthe at least one display device is operable to display the six-primarycolor system based on the set of image data, and wherein the set of SDPparameters is modified to indicate that the set of image data is beingdisplayed on the at least one display device using the six-primary colorsystem.
 8. The system of claim 1, wherein the image data converter isoperable to modulate the updated set of primary color signals accordingto the at least one display device.
 9. The system of claim 8, wherein amodulating signal applied to the at least one display device depends oncharacteristics of the at least one display device, wherein thecharacteristics include gamma characteristics, a luminance, a luminanceunity, a visual acuity, a flicker threshold, a contrast, a contrastpolarity, a resolution, a refresh rate, a temporal instability, apersistence, a color, and/or reflect characteristics.
 10. The system ofclaim 1, wherein the updated set of primary color signals is determinedbased on a lower inter-observer color variation, a smoothness oftransition from a first primary to a second primary, an ability of thesystem to minimize contouring, a mapping of out-of-gamut colors toin-gamut colors, and/or at least one multidimensional look-up table. 11.A system for displaying a six-primary color system, comprising: a set ofimage data; a set of primary color signals, wherein the set of primarycolor signals corresponds to a set of tristimulus values in XYZ colorspace; an image data converter; a set of Session Description Protocol(SDP) parameters, wherein the set of SDP parameters is modifiable; andat least one display device; wherein the at least one display device andthe image data converter are in network communication; wherein the imagedata converter is operable to create an updated set of primary colorsignals from the set of tri stimulus values in XYZ color space and afirst primary triad, a second primary triad, a third primary triad, anda fourth primary triad; wherein the set of image data includes a set ofsaturation data, wherein the set of saturation data is calculated usingthe updated set of primary color signals; wherein the set of saturationdata is used to create an updated set of hue angles for the updated setof primary color signals, wherein the updated set of hue angles includesinverted hue angles; and wherein the image data converter is operable toconvert the set of image data for display on the at least one displaydevice using the updated set of primary color signals.
 12. The system ofclaim 11, wherein the first primary triad includes red (R), green (G),and blue (B) primaries, wherein the second primary triad includes G,cyan (C), and B primaries, wherein the third primary triad includes R,yellow (Y), and G primaries, and wherein the fourth primary triadincludes R, B, and magenta (M) primaries.
 13. The system of claim 11,wherein the first primary triad includes cyan (C), yellow (Y), andmagenta (M) primaries.
 14. The system of claim 11, wherein the imagedata converter is operable to convert the set of tristimulus values inXYZ color space into the first primary triad, the second primary triad,the third primary triad, and the fourth primary triad.
 15. The system ofclaim 11, wherein the updated set of primary color signals is defined bythe first primary triad, the second primary triad, the third primarytriad, and the fourth primary triad.
 16. The system of claim 11, whereinthe image data converter is operable to modulate the updated set ofprimary color signals according to the at least one display device. 17.A system for displaying a set of image data using a six-primary colorsystem, comprising: a set of image data; an image data converter,wherein the image data converter includes a digital interface, whereinthe digital interface is operable to encode and decode the set of imagedata; a set of Session Description Protocol (SDP) parameters; an XYZcolor space matrix, wherein the XYZ color space matrix corresponds to aset of primary color signals; and at least one display device; whereinthe at least one display device and the image data converter are innetwork communication; wherein the image data converter is operable toconvert the set of image data for display on the at least one displaydevice using the XYZ color space matrix and a first primary triad, asecond primary triad, a third primary triad, and a fourth primary triad,thereby creating an updated set of primary color signals; wherein theset of image data includes a set of saturation data, wherein the set ofsaturation data is calculated using the updated set of primary colorsignals; and wherein the set of saturation data is used to create anupdated set of hue angles for the updated set of primary color signals,wherein the updated set of hue angles includes inverted hue angles. 18.The system of claim 17, wherein the first primary triad includes cyan(C), yellow (Y), and magenta (M) primaries.
 19. The system of claim 17,wherein the first primary triad includes red (R), green (G), and blue(B) primaries, wherein the second primary triad includes G, cyan (C),and B primaries, wherein the third primary triad includes R, yellow (Y),and G primaries, and wherein the fourth primary triad includes R, B, andmagenta (M) primaries.
 20. The system of claim 17, wherein the imagedata converter is operable to convert the set of image data to astandard color gamut using the XYZ color space matrix.